2026-03-29 06:15:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 06:15:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 06:15:04 [motorway.uk] INFO: Batch mode enabled: batch 4/4
2026-03-29 06:15:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 06:15:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 06:15:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 06:15:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 06:15:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 06:15:04 [scrapy.extensions.telnet] INFO: Telnet Password: 98218a753ce5a1f0
2026-03-29 06:15:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 06:15:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_2_2026-03-29T06_15_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 06:15:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:15:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:15:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 06:15:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 06:15:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 06:15:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 06:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 06:15:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-29 06:15:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 06:15:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 06:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 06:15:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 06:15:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 06:15:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 06:15:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 06:15:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 06:15:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 06:15:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 06:15:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 06:15:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 06:15:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:15:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:15:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 06:15:13 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZEQTJPakUxT2pFeUxqUXdNVm9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwTnpZME9URXlmUS4tUTVvSmdFdTRIWjhYdFhpWV9SbjUyZFRrbmM0dGlqY0VndVA3QlY1V0pvIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6ImFiMzI4YWFiNWM4OWIxNTA5MTE1ZTY4NjNiZWE4NDE5MmE4N2I2NGU3ODhhMWE1NDMyODhiMmM0NzllYWYxZDgiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0NzY0OTEzMzAxLCJpYXQiOjE3NzQ3NjQ5MTMsImV4cCI6MTc3NDc2NTIxM30.XjPbNCjGQ_ECvm27VjXMDi08KLzOnd7VQzW0pRYjj7M', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 06:15:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 06:15:15 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 06:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20453051
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20424412
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720424412%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20424412: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20454429
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 15889750
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20458811
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20400912
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19858821
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20189927
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720221411%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20221411: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 11169122
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20452842
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 9060017
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19270731
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 10602492
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710602492%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 10602492: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20463841
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 17622892
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717622892%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 17622892: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 18934020
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718934020%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 18934020: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20161394
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720161394%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20161394: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 10368018
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19820727
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 17578440
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20363737
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720363737%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20363737: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19767799
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20455931
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20431949
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20470382
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20074687
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20212525
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720212525%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20212525: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20478200
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720478200%27 HTTP/1.1" 200 None
2026-03-29 06:15:16 [motorway.uk] INFO: Scrape type for 20478200: 0
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20407074
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19745457
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20016365
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 20297201
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 19667411
2026-03-29 06:15:16 [motorway.uk] INFO: Found listing with ID: 18790413
2026-03-29 06:15:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:47 [motorway.uk] INFO: Found listing with ID: 20147462
2026-03-29 06:15:47 [motorway.uk] INFO: Found listing with ID: 20434638
2026-03-29 06:15:47 [motorway.uk] INFO: Found listing with ID: 20367180
2026-03-29 06:15:47 [motorway.uk] INFO: Found listing with ID: 20464956
2026-03-29 06:15:47 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 06:15:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443071%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20443071: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20452886
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720452886%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20452886: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 5358396
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20241454
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 19221106
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719221106%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 19221106: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 9295088
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 19650674
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 19376449
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20112110
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720112110%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20112110: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20214822
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720214822%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20214822: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20459184
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20407610
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407610%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20407610: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 15164886
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20475188
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20418059
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20252490
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 9771818
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 10242530
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20168105
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720168105%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20168105: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20477040
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 16698870
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 11407414
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711407414%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 11407414: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20393118
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 19848751
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20385637
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720385637%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20385637: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20448664
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 19949895
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20445658
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720445658%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 20445658: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 16585471
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716585471%27 HTTP/1.1" 200 None
2026-03-29 06:15:48 [motorway.uk] INFO: Scrape type for 16585471: 0
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20394040
2026-03-29 06:15:48 [motorway.uk] INFO: Found listing with ID: 20474947
2026-03-29 06:15:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 16616169
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20434660
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720434660%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20434660: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20470189
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470189%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20470189: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 14203109
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714203109%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 14203109: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 12358651
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20344294
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20456446
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 18872056
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 16319557
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20335390
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720335390%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20335390: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20401093
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 5646787
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20475386
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475386%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20475386: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20458325
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458325%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20458325: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20144900
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 18836716
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20467079
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 17846420
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20378816
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20422486
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422486%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20422486: 2
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20475140
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 16685526
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20362782
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 10076837
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710076837%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 10076837: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20459428
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459428%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20459428: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20459174
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 19896755
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 19556832
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20471563
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 18952400
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20342551
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720342551%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20342551: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 18946726
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459015%27 HTTP/1.1" 200 None
2026-03-29 06:15:49 [motorway.uk] INFO: Scrape type for 20459015: 0
2026-03-29 06:15:49 [motorway.uk] INFO: Found listing with ID: 20381459
2026-03-29 06:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20460190
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20211194
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 12850662
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20471886
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20469032
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 17691777
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717691777%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 17691777: 2
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20457757
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20432964
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720432964%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 20432964: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 17150490
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 18608681
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718608681%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 18608681: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475074%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 20475074: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20474326
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20469573
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 18848020
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20043252
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 9326734
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279326734%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 9326734: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20476586
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476586%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 20476586: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 17218958
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20420409
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720420409%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 20420409: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20331288
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 15130971
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20472698
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 15970869
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 15457276
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 19242415
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20290974
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 18072707
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 19634886
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719634886%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 19634886: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 14828669
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20465098
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20415084
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 20297667
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720297667%27 HTTP/1.1" 200 None
2026-03-29 06:15:51 [motorway.uk] INFO: Scrape type for 20297667: 0
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 14900794
2026-03-29 06:15:51 [motorway.uk] INFO: Found listing with ID: 15271037
2026-03-29 06:15:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422486.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with identifier: 20422486
2026-03-29 06:15:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with scrape type 2
2026-03-29 06:15:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with scrape type 2
2026-03-29 06:15:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 3775b807-a0ed-5bd9-84e9-b85a51e547e3, identifier: 20422486
2026-03-29 06:15:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with identifier: 20422486
2026-03-29 06:15:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:15:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 06:15:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 06:15:53 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:15:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with identifier: 20422486
2026-03-29 06:15:53 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 3775b807-a0ed-5bd9-84e9-b85a51e547e3 with identifier: 20422486 to the API
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:15:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20422486.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '3775b807-a0ed-5bd9-84e9-b85a51e547e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'WF16 VNR',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20422486',
 'listing': 'auction',
 'location': 'Greater London Carshalton',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 112721,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 4562,
 'price_includes_vat': False,
 'registration_date': '2016-03-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Transit Custom 270 ECO-TECH',
 'transmission': 'manual',
 'trim': 'Custom 270 ECO-TECH',
 'vin': 'WF0YXXTTGYFU82918',
 'year': 2016}
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720422486%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Saving data for 20422486: {'auction_closing_time': 1774798200.0, 'created_time': 1774643028.815764, 'last_price_update_time': 1774764953.478844}
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20422486') HTTP/1.1" 204 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 19310610
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719310610%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 19310610: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 11270287
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 9113523
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 13162464
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20443135
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443135%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 20443135: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20344887
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 7838048
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 17832678
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717832678%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 17832678: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 18981483
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20195490
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20439275
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 18361170
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 17137303
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 12962042
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 9644458
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279644458%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 9644458: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 14735734
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20410706
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 18629843
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 15834331
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 18751494
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20476604
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476604%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 20476604: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20401699
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401699%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 20401699: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 12496076
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 3045051
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 19915046
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 17416045
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 18560542
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20382542
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382542%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 20382542: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20402616
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20266760
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20450634
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20475605
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475605%27 HTTP/1.1" 200 None
2026-03-29 06:15:53 [motorway.uk] INFO: Scrape type for 20475605: 0
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 20207490
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 8640335
2026-03-29 06:15:53 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 06:15:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17691777.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3a2b866-f261-5e06-9caa-c7080bb44284 with identifier: 17691777
2026-03-29 06:15:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3a2b866-f261-5e06-9caa-c7080bb44284 with scrape type 2
2026-03-29 06:15:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3a2b866-f261-5e06-9caa-c7080bb44284 with scrape type 2
2026-03-29 06:15:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d3a2b866-f261-5e06-9caa-c7080bb44284, identifier: 17691777
2026-03-29 06:15:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d3a2b866-f261-5e06-9caa-c7080bb44284 with identifier: 17691777
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 06:15:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:15:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d3a2b866-f261-5e06-9caa-c7080bb44284 with identifier: 17691777
2026-03-29 06:15:54 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d3a2b866-f261-5e06-9caa-c7080bb44284 with identifier: 17691777 to the API
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:15:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17691777.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd3a2b866-f261-5e06-9caa-c7080bb44284',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT67 GXK',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17691777',
 'listing': 'auction',
 'location': 'West Midlands Dudley',
 'make': 'Mazda',
 'model': '3',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9005,
 'price_includes_vat': False,
 'registration_date': '2017-09-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mazda 3 Sport NAV',
 'transmission': 'manual',
 'trim': 'Sport NAV',
 'vin': 'JMZBN647601524070',
 'year': 2017}
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717691777%27 HTTP/1.1" 200 None
2026-03-29 06:15:54 [motorway.uk] INFO: Saving data for 17691777: {'auction_closing_time': 1774798200.0, 'created_time': 1774470122.887629, 'last_price_update_time': 1774764954.476147}
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17691777') HTTP/1.1" 204 0
2026-03-29 06:15:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20174885
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720174885%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 20174885: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 14298754
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19348152
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20424865
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20464288
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464288%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 20464288: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 18852485
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 18303550
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20472974
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20315175
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20456097
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 7350923
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19390538
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 18829738
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718829738%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 18829738: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20354482
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 15683124
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20394729
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20461741
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20375413
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 9334611
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20077130
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720077130%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 20077130: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20430282
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 9610716
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279610716%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 9610716: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 14631572
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 18917393
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20219039
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20460708
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19507165
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19989716
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720111851%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 20111851: 2
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20296846
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20408962
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 11715724
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19043845
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 19977278
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719977278%27 HTTP/1.1" 200 None
2026-03-29 06:15:55 [motorway.uk] INFO: Scrape type for 19977278: 0
2026-03-29 06:15:55 [motorway.uk] INFO: Found listing with ID: 20404977
2026-03-29 06:15:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20161555
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 18026222
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20451099
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20449765
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719430237%27 HTTP/1.1" 200 None
2026-03-29 06:15:57 [motorway.uk] INFO: Scrape type for 19430237: 0
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20247436
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 10157934
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20476838
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 16272859
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20286133
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 11148596
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711148596%27 HTTP/1.1" 200 None
2026-03-29 06:15:57 [motorway.uk] INFO: Scrape type for 11148596: 2
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20338634
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720338634%27 HTTP/1.1" 200 None
2026-03-29 06:15:57 [motorway.uk] INFO: Scrape type for 20338634: 0
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20475599
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19365234
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 3318153
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19741406
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 18488953
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20373110
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 16534865
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20445976
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20067826
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720067826%27 HTTP/1.1" 200 None
2026-03-29 06:15:57 [motorway.uk] INFO: Scrape type for 20067826: 0
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20334765
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 8863156
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19295269
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719295269%27 HTTP/1.1" 200 None
2026-03-29 06:15:57 [motorway.uk] INFO: Scrape type for 19295269: 0
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 12082703
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 20260906
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 14407439
2026-03-29 06:15:57 [motorway.uk] INFO: Found listing with ID: 19555734
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:15:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719555734%27 HTTP/1.1" 200 None
2026-03-29 06:15:58 [motorway.uk] INFO: Scrape type for 19555734: 0
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 16320818
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 20226509
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 15621487
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 20473506
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 15508075
2026-03-29 06:15:58 [motorway.uk] INFO: Found listing with ID: 5756005
2026-03-29 06:15:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:15:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20111851.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:15:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with identifier: 20111851
2026-03-29 06:15:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with scrape type 2
2026-03-29 06:15:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with scrape type 2
2026-03-29 06:15:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 6923a335-5ed5-5f58-8a39-88bd04fd9a6a, identifier: 20111851
2026-03-29 06:15:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with identifier: 20111851
2026-03-29 06:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:15:58 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 06:15:58 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:15:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:15:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with identifier: 20111851
2026-03-29 06:15:58 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 6923a335-5ed5-5f58-8a39-88bd04fd9a6a with identifier: 20111851 to the API
2026-03-29 06:15:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20111851.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.1L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '6923a335-5ed5-5f58-8a39-88bd04fd9a6a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LF55 FOX',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20111851',
 'listing': 'auction',
 'location': 'Merseyside Saint Helens',
 'make': 'Mercedes',
 'model': 'Sprinter',
 'odometer': 46528,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 17488,
 'price_includes_vat': False,
 'registration_date': '2017-02-13',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mercedes Sprinter 316 CDI',
 'transmission': 'manual',
 'trim': '316 CDI',
 'vin': 'WDB9066312P321558',
 'year': 2017}
2026-03-29 06:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720111851%27 HTTP/1.1" 200 None
2026-03-29 06:16:00 [motorway.uk] INFO: Saving data for 20111851: {'auction_closing_time': 1774798200.0, 'created_time': 1774643175.279172, 'last_price_update_time': 1774764960.874698}
2026-03-29 06:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20111851') HTTP/1.1" 204 0
2026-03-29 06:16:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 18388032
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 13473049
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20461730
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 18372204
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 16005095
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716005095%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 16005095: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 15122914
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19793325
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20309629
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720309629%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 20309629: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 9379665
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 17970231
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19902225
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20220920
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720220920%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 20220920: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20018740
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19776443
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20444808
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19723131
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19868174
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719868174%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 19868174: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20462890
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20471245
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471245%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 20471245: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20379565
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20356719
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20105918
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720105918%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 20105918: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 6878005
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 9380986
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20180237
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 16956632
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20230648
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20442136
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 19122214
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20250168
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20360643
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 7497534
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277497534%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Scrape type for 7497534: 0
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20291186
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 20476783
2026-03-29 06:16:01 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 06:16:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11148596.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with identifier: 11148596
2026-03-29 06:16:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with scrape type 2
2026-03-29 06:16:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with scrape type 2
2026-03-29 06:16:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: c42dacf5-48eb-5eb2-b301-dfacd29a94f6, identifier: 11148596
2026-03-29 06:16:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with identifier: 11148596
2026-03-29 06:16:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with identifier: 11148596
2026-03-29 06:16:01 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: c42dacf5-48eb-5eb2-b301-dfacd29a94f6 with identifier: 11148596 to the API
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11148596.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'c42dacf5-48eb-5eb2-b301-dfacd29a94f6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'W22 DWD',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11148596',
 'listing': 'auction',
 'location': 'Cornwall Redruth',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 46000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 8611,
 'price_includes_vat': False,
 'registration_date': '2017-11-09',
 'seats_number': None,
 'seller_name': None,
 'title': 'Volkswagen Caddy C20 Startline TDI',
 'transmission': 'manual',
 'trim': 'C20 Startline TDI',
 'vin': 'WV1ZZZ2KZJX018648',
 'year': 2017}
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711148596%27 HTTP/1.1" 200 None
2026-03-29 06:16:01 [motorway.uk] INFO: Saving data for 11148596: {'auction_closing_time': 1774798200.0, 'created_time': 1774643434.404904, 'last_price_update_time': 1774764961.944459}
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11148596') HTTP/1.1" 204 0
2026-03-29 06:16:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20389051
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 14132049
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20266972
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720266972%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20266972: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20470887
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 19231087
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 17206340
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 19648721
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719648721%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 19648721: 2
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 13711120
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 6061364
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276061364%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 6061364: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20467571
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 16932861
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 16337094
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20279234
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720279234%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20279234: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20310408
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720310408%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20310408: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20473711
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 19627347
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719627347%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 19627347: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 16854289
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 18257606
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 13451992
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20453903
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720453903%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20453903: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20131872
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20272549
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 15758012
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715758012%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 15758012: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 19310694
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20473706
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473706%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20473706: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 16417060
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 4941184
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20368484
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 2300054
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 6271057
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 11539399
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20441488
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441488%27 HTTP/1.1" 200 None
2026-03-29 06:16:02 [motorway.uk] INFO: Scrape type for 20441488: 0
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 20467601
2026-03-29 06:16:02 [motorway.uk] INFO: Found listing with ID: 9051717
2026-03-29 06:16:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 9752236
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279752236%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 9752236: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20457087
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 15766321
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 16712991
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20455561
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20342759
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20474399
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474399%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 20474399: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 19081062
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719081062%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 19081062: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20473913
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20419308
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20389211
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20472427
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20470626
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470626%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 20470626: 2
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 14890152
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714890152%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 14890152: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 18462191
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718462191%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 18462191: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 17876387
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20391858
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720391858%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 20391858: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 19333245
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 7488696
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 19986865
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 16484532
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716484532%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 16484532: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20408325
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20179240
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720179240%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 20179240: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 13765540
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 17076457
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20405382
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20332192
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20475400
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 1639917
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 18991011
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718991011%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 18991011: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20466183
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466183%27 HTTP/1.1" 200 None
2026-03-29 06:16:04 [motorway.uk] INFO: Scrape type for 20466183: 0
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 18479232
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 19605478
2026-03-29 06:16:04 [motorway.uk] INFO: Found listing with ID: 20361020
2026-03-29 06:16:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20471470
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20343152
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 19737512
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 17592195
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20455379
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 7102372
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20340723
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 9859136
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279859136%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 9859136: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 12142270
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 19096344
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20101792
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20231542
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 16313324
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20471336
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20407422
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407422%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20407422: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20300321
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720300321%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20300321: 2
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20350333
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 17904698
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717904698%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 17904698: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20343098
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20388448
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388448%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20388448: 2
2026-03-29 06:16:05 [scrapy.extensions.logstats] INFO: Crawled 18 pages (at 18 pages/min), scraped 4 items (at 4 items/min)
2026-03-29 06:16:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 06:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20463004
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463004%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20463004: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20391563
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20464938
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 18741821
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718741821%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 18741821: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20279144
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 9771799
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20366934
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720366934%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20366934: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20347498
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 17557803
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717557803%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 17557803: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20316360
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 19220082
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 6255978
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20454459
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20416980
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720416980%27 HTTP/1.1" 200 None
2026-03-29 06:16:05 [motorway.uk] INFO: Scrape type for 20416980: 0
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20357566
2026-03-29 06:16:05 [motorway.uk] INFO: Found listing with ID: 20467996
2026-03-29 06:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19648721.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c084683-5579-547d-af18-68ab7b80ffe9 with identifier: 19648721
2026-03-29 06:16:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c084683-5579-547d-af18-68ab7b80ffe9 with scrape type 2
2026-03-29 06:16:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4c084683-5579-547d-af18-68ab7b80ffe9 with scrape type 2
2026-03-29 06:16:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 4c084683-5579-547d-af18-68ab7b80ffe9, identifier: 19648721
2026-03-29 06:16:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 4c084683-5579-547d-af18-68ab7b80ffe9 with identifier: 19648721
2026-03-29 06:16:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 4c084683-5579-547d-af18-68ab7b80ffe9 with identifier: 19648721
2026-03-29 06:16:06 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 4c084683-5579-547d-af18-68ab7b80ffe9 with identifier: 19648721 to the API
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19648721.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '4c084683-5579-547d-af18-68ab7b80ffe9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DG17 ODK',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19648721',
 'listing': 'auction',
 'location': 'Kent Tunbridge Wells',
 'make': 'Abarth',
 'model': '595',
 'odometer': 43155,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 8136,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Abarth 595 Competizione',
 'transmission': 'manual',
 'trim': 'Competizione',
 'vin': 'ZFA3120000J703143',
 'year': 2017}
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719648721%27 HTTP/1.1" 200 None
2026-03-29 06:16:06 [motorway.uk] INFO: Saving data for 19648721: {'auction_closing_time': 1774798200.0, 'created_time': 1774643039.692301, 'last_price_update_time': 1774764966.282256}
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19648721') HTTP/1.1" 204 0
2026-03-29 06:16:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470626.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with identifier: 20470626
2026-03-29 06:16:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with scrape type 2
2026-03-29 06:16:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with scrape type 2
2026-03-29 06:16:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 333b17d4-3e92-51dc-b4b1-5ce7dca0257f, identifier: 20470626
2026-03-29 06:16:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with identifier: 20470626
2026-03-29 06:16:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 06:16:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with identifier: 20470626
2026-03-29 06:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 333b17d4-3e92-51dc-b4b1-5ce7dca0257f with identifier: 20470626 to the API
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20470626.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '333b17d4-3e92-51dc-b4b1-5ce7dca0257f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SO07 BHA',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20470626',
 'listing': 'auction',
 'location': 'Devon Exeter',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 60000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 8955,
 'price_includes_vat': False,
 'registration_date': '2018-06-28',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Fiesta ST-2 Turbo',
 'transmission': 'manual',
 'trim': 'ST-2 Turbo',
 'vin': 'WF0JXXGAHJJU21416',
 'year': 2018}
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470626%27 HTTP/1.1" 200 None
2026-03-29 06:16:07 [motorway.uk] INFO: Saving data for 20470626: {'auction_closing_time': 1774798200.0, 'created_time': 1774642994.461263, 'last_price_update_time': 1774764967.379752}
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20470626') HTTP/1.1" 204 0
2026-03-29 06:16:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20388448.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4b7d413-6cc7-52f5-8621-8a1dc3504680 with identifier: 20388448
2026-03-29 06:16:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4b7d413-6cc7-52f5-8621-8a1dc3504680 with scrape type 2
2026-03-29 06:16:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4b7d413-6cc7-52f5-8621-8a1dc3504680 with scrape type 2
2026-03-29 06:16:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d4b7d413-6cc7-52f5-8621-8a1dc3504680, identifier: 20388448
2026-03-29 06:16:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d4b7d413-6cc7-52f5-8621-8a1dc3504680 with identifier: 20388448
2026-03-29 06:16:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d4b7d413-6cc7-52f5-8621-8a1dc3504680 with identifier: 20388448
2026-03-29 06:16:07 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d4b7d413-6cc7-52f5-8621-8a1dc3504680 with identifier: 20388448 to the API
2026-03-29 06:16:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20388448.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd4b7d413-6cc7-52f5-8621-8a1dc3504680',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MF69 XDE',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20388448',
 'listing': 'auction',
 'location': 'Staffordshire Ashbourne',
 'make': 'MINI',
 'model': 'Cooper',
 'odometer': 25000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9545,
 'price_includes_vat': False,
 'registration_date': '2019-12-12',
 'seats_number': None,
 'seller_name': None,
 'title': 'MINI Cooper Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'vin': 'WMWXR320402M32661',
 'year': 2019}
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720388448%27 HTTP/1.1" 200 None
2026-03-29 06:16:08 [motorway.uk] INFO: Saving data for 20388448: {'auction_closing_time': 1774798200.0, 'created_time': 1774642973.3372, 'last_price_update_time': 1774764968.23777}
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20388448') HTTP/1.1" 204 0
2026-03-29 06:16:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20300321.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cdf3887-b395-5fad-b218-136800bd639a with identifier: 20300321
2026-03-29 06:16:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cdf3887-b395-5fad-b218-136800bd639a with scrape type 2
2026-03-29 06:16:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cdf3887-b395-5fad-b218-136800bd639a with scrape type 2
2026-03-29 06:16:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 2cdf3887-b395-5fad-b218-136800bd639a, identifier: 20300321
2026-03-29 06:16:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 2cdf3887-b395-5fad-b218-136800bd639a with identifier: 20300321
2026-03-29 06:16:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 2cdf3887-b395-5fad-b218-136800bd639a with identifier: 20300321
2026-03-29 06:16:08 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 2cdf3887-b395-5fad-b218-136800bd639a with identifier: 20300321 to the API
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20300321.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '2cdf3887-b395-5fad-b218-136800bd639a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'YR65 YTL',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20300321',
 'listing': 'auction',
 'location': 'Derby Derby',
 'make': 'Vauxhall',
 'model': 'Adam',
 'odometer': 102915,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 2080,
 'price_includes_vat': False,
 'registration_date': '2015-09-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Vauxhall Adam Glam',
 'transmission': 'manual',
 'trim': 'Glam',
 'vin': 'W0L0MAP08F6028847',
 'year': 2015}
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720300321%27 HTTP/1.1" 200 None
2026-03-29 06:16:08 [motorway.uk] INFO: Saving data for 20300321: {'auction_closing_time': 1774798200.0, 'created_time': 1774643565.571301, 'last_price_update_time': 1774764968.99439}
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20300321') HTTP/1.1" 204 0
2026-03-29 06:16:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 16845807
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 16400774
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20373105
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720373105%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 20373105: 0
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19370870
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719370870%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 19370870: 2
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19885907
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20086616
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 8548948
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20453293
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20366333
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19052366
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 18610915
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20474573
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20363171
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19674536
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20199957
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20454873
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 15388563
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715388563%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 15388563: 2
2026-03-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 14183290
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714183290%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 14183290: 2
2026-03-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20110750
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20220593
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20471175
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20219769
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720219769%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 20219769: 2
2026-03-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20318300
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720318300%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 20318300: 0
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20267440
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 8580676
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20404892
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 6628569
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20395141
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 17937377
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 18039395
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20131379
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 2695619
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19337514
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719337514%27 HTTP/1.1" 200 None
2026-03-29 06:16:09 [motorway.uk] INFO: Scrape type for 19337514: 0
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 19281948
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 20212581
2026-03-29 06:16:09 [motorway.uk] INFO: Found listing with ID: 12347784
2026-03-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:10 [motorway.uk] INFO: Found listing with ID: 20196170
2026-03-29 06:16:10 [motorway.uk] INFO: Found listing with ID: 20469645
2026-03-29 06:16:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469645%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 20469645: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 18070489
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20413892
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20262525
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19991580
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719991580%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 19991580: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20397299
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20172330
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20098206
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19917549
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20421278
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 17970165
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19570710
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 9130362
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19807649
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 17253097
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717253097%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 17253097: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20361949
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720361949%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 20361949: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20470085
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470085%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 20470085: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 17800051
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717800051%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 17800051: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20473970
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20366562
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20031019
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19861655
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719861655%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 19861655: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20441604
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20463099
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720463099%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 20463099: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19510740
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20402747
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20429067
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720429067%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 20429067: 0
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19475854
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719475854%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 19475854: 2
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 15978781
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 13033778
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713033778%27 HTTP/1.1" 200 None
2026-03-29 06:16:11 [motorway.uk] INFO: Scrape type for 13033778: 2
2026-03-29 06:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 20026360
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19775049
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 18362922
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19155544
2026-03-29 06:16:11 [motorway.uk] INFO: Found listing with ID: 19093843
2026-03-29 06:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 16513638
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19222213
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 14988665
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19925838
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20127776
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19866142
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719866142%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 19866142: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20350830
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720350830%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 20350830: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20065381
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19121190
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20469777
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 10469814
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20342588
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19246820
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719246820%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 19246820: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20235127
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20469374
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 13284537
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 15736589
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 18911907
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20440317
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20387515
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 16182811
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20238382
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 19954553
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 14335353
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20389632
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720389632%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 20389632: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 17183075
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 17766139
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717766139%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 17766139: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 18827095
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 15165987
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 6574407
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20250456
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720250456%27 HTTP/1.1" 200 None
2026-03-29 06:16:12 [motorway.uk] INFO: Scrape type for 20250456: 0
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20391180
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 6111493
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20470936
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20427924
2026-03-29 06:16:12 [motorway.uk] INFO: Found listing with ID: 20472901
2026-03-29 06:16:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20219769.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with identifier: 20219769
2026-03-29 06:16:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with scrape type 2
2026-03-29 06:16:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with scrape type 2
2026-03-29 06:16:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 5b70a240-0b81-5497-b14c-2813ed2d0ae0, identifier: 20219769
2026-03-29 06:16:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with identifier: 20219769
2026-03-29 06:16:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with identifier: 20219769
2026-03-29 06:16:13 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 5b70a240-0b81-5497-b14c-2813ed2d0ae0 with identifier: 20219769 to the API
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20219769.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '5b70a240-0b81-5497-b14c-2813ed2d0ae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GC19 ZNX',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20219769',
 'listing': 'auction',
 'location': 'Merseyside Birkenhead',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 60090,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 11368,
 'price_includes_vat': False,
 'registration_date': '2019-07-04',
 'seats_number': None,
 'seller_name': None,
 'title': 'Volkswagen Passat SE Business TSI EVO S-A',
 'transmission': 'automatic',
 'trim': 'SE Business TSI EVO S-A',
 'vin': 'WVWZZZ3CZKE104788',
 'year': 2019}
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720219769%27 HTTP/1.1" 200 None
2026-03-29 06:16:13 [motorway.uk] INFO: Saving data for 20219769: {'auction_closing_time': 1774798200.0, 'created_time': 1774384135.103135, 'last_price_update_time': 1774764973.652387}
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20219769') HTTP/1.1" 204 0
2026-03-29 06:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14183290.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15388563.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4997586-0323-51a6-b929-691b9f75dd71 with identifier: 14183290
2026-03-29 06:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f4997586-0323-51a6-b929-691b9f75dd71 with scrape type 2
2026-03-29 06:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f4997586-0323-51a6-b929-691b9f75dd71 with scrape type 2
2026-03-29 06:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f4997586-0323-51a6-b929-691b9f75dd71, identifier: 14183290
2026-03-29 06:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f4997586-0323-51a6-b929-691b9f75dd71 with identifier: 14183290
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 06:16:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f4997586-0323-51a6-b929-691b9f75dd71 with identifier: 14183290
2026-03-29 06:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f4997586-0323-51a6-b929-691b9f75dd71 with identifier: 14183290 to the API
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/14183290.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'f4997586-0323-51a6-b929-691b9f75dd71',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'WR19 ONS',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/14183290',
 'listing': 'auction',
 'location': 'Scottish Borders Galashiels',
 'make': 'Volkswagen',
 'model': 'Golf',
 'odometer': 37651,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 20801,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Volkswagen Golf R TSI 4MOTION S-A',
 'transmission': 'automatic',
 'trim': 'R TSI 4MOTION S-A',
 'vin': 'WVWZZZAUZKW101249',
 'year': 2019}
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714183290%27 HTTP/1.1" 200 None
2026-03-29 06:16:14 [motorway.uk] INFO: Saving data for 14183290: {'auction_closing_time': 1774798200.0, 'created_time': 1774643417.847239, 'last_price_update_time': 1774764974.650943}
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='14183290') HTTP/1.1" 204 0
2026-03-29 06:16:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with identifier: 15388563
2026-03-29 06:16:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with scrape type 2
2026-03-29 06:16:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with scrape type 2
2026-03-29 06:16:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8b8ef257-b6d9-5c4c-90ab-c086800735d0, identifier: 15388563
2026-03-29 06:16:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with identifier: 15388563
2026-03-29 06:16:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with identifier: 15388563
2026-03-29 06:16:14 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8b8ef257-b6d9-5c4c-90ab-c086800735d0 with identifier: 15388563 to the API
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15388563.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '8b8ef257-b6d9-5c4c-90ab-c086800735d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'T30 WNN',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15388563',
 'listing': 'auction',
 'location': 'West Yorkshire Huddersfield',
 'make': 'Daihatsu',
 'model': 'Terios',
 'odometer': 90600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 901,
 'price_includes_vat': False,
 'registration_date': '2008-09-29',
 'seats_number': None,
 'seller_name': None,
 'title': 'Daihatsu Terios SX',
 'transmission': 'manual',
 'trim': 'SX',
 'vin': 'JDAJ210G001064115',
 'year': 2008}
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715388563%27 HTTP/1.1" 200 None
2026-03-29 06:16:15 [motorway.uk] INFO: Saving data for 15388563: {'auction_closing_time': 1774798200.0, 'created_time': 1774643562.302949, 'last_price_update_time': 1774764975.100385}
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15388563') HTTP/1.1" 204 0
2026-03-29 06:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19370870.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13033778.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with identifier: 19370870
2026-03-29 06:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with scrape type 2
2026-03-29 06:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with scrape type 2
2026-03-29 06:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d, identifier: 19370870
2026-03-29 06:16:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9393bdd-c948-50b6-8383-592792559d43 with identifier: 13033778
2026-03-29 06:16:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9393bdd-c948-50b6-8383-592792559d43 with scrape type 2
2026-03-29 06:16:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9393bdd-c948-50b6-8383-592792559d43 with scrape type 2
2026-03-29 06:16:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: a9393bdd-c948-50b6-8383-592792559d43, identifier: 13033778
2026-03-29 06:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with identifier: 19370870
2026-03-29 06:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with identifier: 19370870
2026-03-29 06:16:15 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d with identifier: 19370870 to the API
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19370870.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.3L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'e4d2aa88-a0bf-5f79-95fb-f2ea3c059b4d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DYZ 1608',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19370870',
 'listing': 'auction',
 'location': 'Derry and Strabane Strabane',
 'make': 'Renault',
 'model': 'Other Renault',
 'odometer': 34250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 11761,
 'price_includes_vat': False,
 'registration_date': '2022-06-10',
 'seats_number': None,
 'seller_name': None,
 'title': 'Renault Arkana RS Line TCE MHEV Auto',
 'transmission': 'automatic',
 'trim': 'Arkana RS Line TCE MHEV Auto',
 'vin': 'VF1RJL009UC304744',
 'year': 2022}
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719370870%27 HTTP/1.1" 200 None
2026-03-29 06:16:15 [motorway.uk] INFO: Saving data for 19370870: {'auction_closing_time': 1774798200.0, 'created_time': 1774643700.671202, 'last_price_update_time': 1774764975.819485}
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19370870') HTTP/1.1" 204 0
2026-03-29 06:16:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: a9393bdd-c948-50b6-8383-592792559d43 with identifier: 13033778
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Gold HTTP/1.1" 200 None
2026-03-29 06:16:15 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:16:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:16:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: a9393bdd-c948-50b6-8383-592792559d43 with identifier: 13033778
2026-03-29 06:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: a9393bdd-c948-50b6-8383-592792559d43 with identifier: 13033778 to the API
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/13033778.json>
{'auction_title': '',
 'category': None,
 'color': 'Gold',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '4.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'a9393bdd-c948-50b6-8383-592792559d43',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LXZ 373',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/13033778',
 'listing': 'auction',
 'location': 'Belfast Belfast',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 137991,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9602,
 'price_includes_vat': False,
 'registration_date': '2014-03-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Land Rover Range Rover AUTO-B SDV8 A',
 'transmission': 'automatic',
 'trim': 'AUTO-B SDV8 A',
 'vin': 'SALGA2JE7EA157598',
 'year': 2014}
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713033778%27 HTTP/1.1" 200 None
2026-03-29 06:16:16 [motorway.uk] INFO: Saving data for 13033778: {'auction_closing_time': 1774798200.0, 'created_time': 1774298885.82831, 'last_price_update_time': 1774764976.289613}
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='13033778') HTTP/1.1" 204 0
2026-03-29 06:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19475854.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with identifier: 19475854
2026-03-29 06:16:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with scrape type 2
2026-03-29 06:16:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with scrape type 2
2026-03-29 06:16:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c, identifier: 19475854
2026-03-29 06:16:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with identifier: 19475854
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 06:16:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:16:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with identifier: 19475854
2026-03-29 06:16:16 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c with identifier: 19475854 to the API
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19475854.json>
{'auction_title': '',
 'category': None,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.3L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'fb35b0a8-2bc7-5e26-bdd9-ff1e4370e47c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'MK19 ONR',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19475854',
 'listing': 'auction',
 'location': 'None None',
 'make': 'Mercedes',
 'model': 'A Class',
 'odometer': 83400,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 8243,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mercedes A 180 AMG Line',
 'transmission': 'manual',
 'trim': 'A 180 AMG Line',
 'vin': 'WDD1770842N040935',
 'year': 2019}
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719475854%27 HTTP/1.1" 200 None
2026-03-29 06:16:16 [motorway.uk] INFO: Saving data for 19475854: {'auction_closing_time': 1774798200.0, 'created_time': 1774643461.241358, 'last_price_update_time': 1774764976.932202}
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19475854') HTTP/1.1" 204 0
2026-03-29 06:16:16 [motorway.uk] INFO: Found listing with ID: 20274978
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720274978%27 HTTP/1.1" 200 None
2026-03-29 06:16:16 [motorway.uk] INFO: Scrape type for 20274978: 0
2026-03-29 06:16:16 [motorway.uk] INFO: Found listing with ID: 19424427
2026-03-29 06:16:16 [motorway.uk] INFO: Found listing with ID: 20459782
2026-03-29 06:16:16 [motorway.uk] INFO: Found listing with ID: 16464746
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716464746%27 HTTP/1.1" 200 None
2026-03-29 06:16:16 [motorway.uk] INFO: Scrape type for 16464746: 0
2026-03-29 06:16:16 [motorway.uk] INFO: Found listing with ID: 19250312
2026-03-29 06:16:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719250312%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 19250312: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20472778
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 881696
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%27881696%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 881696: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20440012
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20443168
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720443168%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 20443168: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 16100448
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20366498
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20466645
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 13582420
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713582420%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 13582420: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 11628897
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 5520581
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20447988
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20288290
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720288290%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 20288290: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20427489
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20252853
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19086772
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719086772%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 19086772: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19622244
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20420787
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20467849
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467849%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 20467849: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 8685990
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278685990%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 8685990: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19099521
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719099521%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 19099521: 2
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 18276303
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 15957419
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 5137777
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20277289
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19894031
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719894031%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 19894031: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20380265
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720380265%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 20380265: 0
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19808818
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 19088331
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20475870
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 20021231
2026-03-29 06:16:17 [motorway.uk] INFO: Found listing with ID: 9756607
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279756607%27 HTTP/1.1" 200 None
2026-03-29 06:16:17 [motorway.uk] INFO: Scrape type for 9756607: 0
2026-03-29 06:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20360457
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 9767952
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 16453749
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20039733
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 6988274
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20353328
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 9261606
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279261606%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 9261606: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20460986
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 17932889
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20460256
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20407283
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407283%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 20407283: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20471112
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 17989976
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20475208
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 9487324
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279487324%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 9487324: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 15564979
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715564979%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 15564979: 2
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19215504
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 18063263
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718063263%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 18063263: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19578369
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 16932806
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19918647
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 1809812
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 4787934
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20428964
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428964%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 20428964: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20413909
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 14252223
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19777443
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19551479
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20459100
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19963155
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719963155%27 HTTP/1.1" 200 None
2026-03-29 06:16:18 [motorway.uk] INFO: Scrape type for 19963155: 0
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 20472366
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 19700534
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 14847848
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 10460674
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 12755614
2026-03-29 06:16:18 [motorway.uk] INFO: Found listing with ID: 10406829
2026-03-29 06:16:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19099521.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f06bc788-8cf8-5ebe-b9df-3ee013bb638c with identifier: 19099521
2026-03-29 06:16:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f06bc788-8cf8-5ebe-b9df-3ee013bb638c with scrape type 2
2026-03-29 06:16:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f06bc788-8cf8-5ebe-b9df-3ee013bb638c with scrape type 2
2026-03-29 06:16:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: f06bc788-8cf8-5ebe-b9df-3ee013bb638c, identifier: 19099521
2026-03-29 06:16:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: f06bc788-8cf8-5ebe-b9df-3ee013bb638c with identifier: 19099521
2026-03-29 06:16:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: f06bc788-8cf8-5ebe-b9df-3ee013bb638c with identifier: 19099521
2026-03-29 06:16:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: f06bc788-8cf8-5ebe-b9df-3ee013bb638c with identifier: 19099521 to the API
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19099521.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'f06bc788-8cf8-5ebe-b9df-3ee013bb638c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'SC16 ZGB',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19099521',
 'listing': 'auction',
 'location': 'Highland Council Dornoch',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 45529,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 2995,
 'price_includes_vat': False,
 'registration_date': '2016-05-31',
 'seats_number': None,
 'seller_name': None,
 'title': 'Peugeot 208 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'vin': 'VF3CCZMZ6GT076151',
 'year': 2016}
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719099521%27 HTTP/1.1" 200 None
2026-03-29 06:16:19 [motorway.uk] INFO: Saving data for 19099521: {'auction_closing_time': 1774798200.0, 'created_time': 1774643582.757833, 'last_price_update_time': 1774764979.764567}
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19099521') HTTP/1.1" 204 0
2026-03-29 06:16:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 20457275
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 4427220
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 20459194
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 20475878
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 20334682
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 20425372
2026-03-29 06:16:19 [motorway.uk] INFO: Found listing with ID: 17114477
2026-03-29 06:16:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717114477%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 17114477: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20461914
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 19622834
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20360461
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20122733
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20236371
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720236371%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 20236371: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20000790
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20474416
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20467523
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20388608
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20465341
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20467731
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467731%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 20467731: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 19933908
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20177902
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720177902%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 20177902: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20476031
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 16667338
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 14174433
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714174433%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 14174433: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20175164
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 19536345
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20472455
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20458967
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458967%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 20458967: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20473093
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 17151245
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717151245%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 17151245: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 9468463
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 6574245
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276574245%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 6574245: 0
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20356418
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20233857
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 20315816
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 167780
2026-03-29 06:16:20 [motorway.uk] INFO: Found listing with ID: 19703945
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719703945%27 HTTP/1.1" 200 None
2026-03-29 06:16:20 [motorway.uk] INFO: Scrape type for 19703945: 0
2026-03-29 06:16:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15564979.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with identifier: 15564979
2026-03-29 06:16:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with scrape type 2
2026-03-29 06:16:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with scrape type 2
2026-03-29 06:16:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 775613d3-e60e-52cb-8696-3a5c7a6fe5f7, identifier: 15564979
2026-03-29 06:16:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with identifier: 15564979
2026-03-29 06:16:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with identifier: 15564979
2026-03-29 06:16:21 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 775613d3-e60e-52cb-8696-3a5c7a6fe5f7 with identifier: 15564979 to the API
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15564979.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '775613d3-e60e-52cb-8696-3a5c7a6fe5f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT12 JFK',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15564979',
 'listing': 'auction',
 'location': 'Surrey Guildford',
 'make': 'Audi',
 'model': 'A3',
 'odometer': 132000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 1276,
 'price_includes_vat': False,
 'registration_date': '2012-03-02',
 'seats_number': None,
 'seller_name': None,
 'title': 'Audi A3 Sport 138 TDI',
 'transmission': 'manual',
 'trim': 'Sport 138 TDI',
 'vin': 'TRUZZZ8PXC1004693',
 'year': 2012}
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715564979%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Saving data for 15564979: {'auction_closing_time': 1774798200.0, 'created_time': 1774643679.503786, 'last_price_update_time': 1774764981.605081}
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15564979') HTTP/1.1" 204 0
2026-03-29 06:16:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 17533899
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717533899%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 17533899: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19672096
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20091960
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720091960%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20091960: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20285041
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20249930
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720249930%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20249930: 2
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 7475704
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20335518
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19362793
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19659928
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20426705
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20190784
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 16807098
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20384128
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20439775
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439775%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20439775: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 5379551
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19543949
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19286603
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719286603%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 19286603: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20465107
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20242691
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720242691%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20242691: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20203882
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 15811586
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20405732
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19668967
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20113593
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20407661
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720407661%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20407661: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19998115
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20146343
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720146343%27 HTTP/1.1" 200 None
2026-03-29 06:16:21 [motorway.uk] INFO: Scrape type for 20146343: 0
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 14161948
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 19936942
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20451036
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20330355
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 15201909
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20286221
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20428995
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20249251
2026-03-29 06:16:21 [motorway.uk] INFO: Found listing with ID: 20472915
2026-03-29 06:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20473376
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20292229
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20435979
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20391868
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20330745
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20448027
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 18590459
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 19075996
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20380694
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20457911
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20463932
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20470621
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 19784782
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719784782%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 19784782: 0
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 11288581
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 19768875
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20394436
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394436%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 20394436: 2
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20414221
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20438780
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438780%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 20438780: 2
2026-03-29 06:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20069102
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 17975819
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20397268
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20469112
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469112%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 20469112: 0
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 12376286
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20174154
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20406035
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20324057
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20460902
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 5468449
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275468449%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 5468449: 0
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 18606457
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718606457%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 18606457: 0
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20428940
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20433844
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 19472834
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719472834%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 19472834: 2
2026-03-29 06:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 19999834
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20445876
2026-03-29 06:16:23 [motorway.uk] INFO: Found listing with ID: 20382047
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720382047%27 HTTP/1.1" 200 None
2026-03-29 06:16:23 [motorway.uk] INFO: Scrape type for 20382047: 0
2026-03-29 06:16:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:16:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20249930.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with identifier: 20249930
2026-03-29 06:16:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with scrape type 2
2026-03-29 06:16:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with scrape type 2
2026-03-29 06:16:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8679a01a-0b2d-59bf-8cf7-ef26b5838095, identifier: 20249930
2026-03-29 06:16:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with identifier: 20249930
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 06:16:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:16:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with identifier: 20249930
2026-03-29 06:16:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8679a01a-0b2d-59bf-8cf7-ef26b5838095 with identifier: 20249930 to the API
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20249930.json>
{'auction_title': '',
 'category': None,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '3.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '8679a01a-0b2d-59bf-8cf7-ef26b5838095',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'EN12 RDZ',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20249930',
 'listing': 'auction',
 'location': 'Bournemouth Bournemouth',
 'make': 'BMW',
 'model': '3 Series',
 'odometer': 69900,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 4062,
 'price_includes_vat': False,
 'registration_date': '2012-06-27',
 'seats_number': None,
 'seller_name': None,
 'title': 'BMW 325I M Sport Auto',
 'transmission': 'automatic',
 'trim': '325I M Sport Auto',
 'vin': 'WBAKE52070E720593',
 'year': 2012}
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720249930%27 HTTP/1.1" 200 None
2026-03-29 06:16:24 [motorway.uk] INFO: Saving data for 20249930: {'auction_closing_time': 1774798200.0, 'created_time': 1774643480.611961, 'last_price_update_time': 1774764984.585363}
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20249930') HTTP/1.1" 204 0
2026-03-29 06:16:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20438780.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e31db0f9-239a-5dff-9458-c398b24572f2 with identifier: 20438780
2026-03-29 06:16:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e31db0f9-239a-5dff-9458-c398b24572f2 with scrape type 2
2026-03-29 06:16:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e31db0f9-239a-5dff-9458-c398b24572f2 with scrape type 2
2026-03-29 06:16:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: e31db0f9-239a-5dff-9458-c398b24572f2, identifier: 20438780
2026-03-29 06:16:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: e31db0f9-239a-5dff-9458-c398b24572f2 with identifier: 20438780
2026-03-29 06:16:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: e31db0f9-239a-5dff-9458-c398b24572f2 with identifier: 20438780
2026-03-29 06:16:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: e31db0f9-239a-5dff-9458-c398b24572f2 with identifier: 20438780 to the API
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20438780.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.8L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'e31db0f9-239a-5dff-9458-c398b24572f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'NX10 FYS',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20438780',
 'listing': 'auction',
 'location': 'West Yorkshire Leeds',
 'make': 'Mazda',
 'model': '6',
 'odometer': 99135,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 796,
 'price_includes_vat': False,
 'registration_date': '2010-03-27',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mazda 6 TS',
 'transmission': 'manual',
 'trim': 'TS',
 'vin': 'JMZGH148211401481',
 'year': 2010}
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720438780%27 HTTP/1.1" 200 None
2026-03-29 06:16:26 [motorway.uk] INFO: Saving data for 20438780: {'auction_closing_time': 1774798200.0, 'created_time': 1774643699.131422, 'last_price_update_time': 1774764986.851059}
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20438780') HTTP/1.1" 204 0
2026-03-29 06:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19472834.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with identifier: 19472834
2026-03-29 06:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with scrape type 2
2026-03-29 06:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with scrape type 2
2026-03-29 06:16:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a, identifier: 19472834
2026-03-29 06:16:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with identifier: 19472834
2026-03-29 06:16:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with identifier: 19472834
2026-03-29 06:16:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 098fbb48-e1e0-5ccb-b812-69b0d2e9de5a with identifier: 19472834 to the API
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19472834.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '098fbb48-e1e0-5ccb-b812-69b0d2e9de5a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'PK14 XFX',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19472834',
 'listing': 'auction',
 'location': 'Midlothian Dalkeith',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 123000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 1880,
 'price_includes_vat': False,
 'registration_date': '2014-04-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Skoda Octavia Elegance TSI',
 'transmission': 'manual',
 'trim': 'Elegance TSI',
 'vin': 'TMBBC7NE7E0206873',
 'year': 2014}
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719472834%27 HTTP/1.1" 200 None
2026-03-29 06:16:27 [motorway.uk] INFO: Saving data for 19472834: {'auction_closing_time': 1774798200.0, 'created_time': 1774643699.904611, 'last_price_update_time': 1774764987.758141}
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19472834') HTTP/1.1" 204 0
2026-03-29 06:16:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20394436.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:16:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40e2df31-3d25-58fa-bec1-dff9f92027ab with identifier: 20394436
2026-03-29 06:16:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40e2df31-3d25-58fa-bec1-dff9f92027ab with scrape type 2
2026-03-29 06:16:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40e2df31-3d25-58fa-bec1-dff9f92027ab with scrape type 2
2026-03-29 06:16:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 40e2df31-3d25-58fa-bec1-dff9f92027ab, identifier: 20394436
2026-03-29 06:16:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 40e2df31-3d25-58fa-bec1-dff9f92027ab with identifier: 20394436
2026-03-29 06:16:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 40e2df31-3d25-58fa-bec1-dff9f92027ab with identifier: 20394436
2026-03-29 06:16:28 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 40e2df31-3d25-58fa-bec1-dff9f92027ab with identifier: 20394436 to the API
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:16:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20394436.json>
{'auction_title': '',
 'category': None,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '40e2df31-3d25-58fa-bec1-dff9f92027ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SG12 MJU',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20394436',
 'listing': 'auction',
 'location': 'East Dunbartonshire Glasgow',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 59000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 1641,
 'price_includes_vat': False,
 'registration_date': '2012-03-03',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Fiesta Zetec',
 'transmission': 'manual',
 'trim': 'Zetec',
 'vin': 'WF0GXXGAJGCB19744',
 'year': 2012}
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394436%27 HTTP/1.1" 200 None
2026-03-29 06:16:28 [motorway.uk] INFO: Saving data for 20394436: {'auction_closing_time': 1774798200.0, 'created_time': 1774643703.239459, 'last_price_update_time': 1774764988.390465}
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:16:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20394436') HTTP/1.1" 204 0
2026-03-29 06:16:28 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 06:16:28 [motorway.uk] INFO: motorway.uk Batch config: batch 4/4
2026-03-29 06:16:28 [motorway.uk] INFO: motorway.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-29 06:16:28 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (20 items) in: file:///var/lib/scrapyd/items/sourcing_v2/motorway.uk/task_2_2026-03-29T06_15_00.jl
2026-03-29 06:16:28 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 93773,
 'downloader/request_count': 42,
 'downloader/request_method_count/GET': 41,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 11992357,
 'downloader/response_count': 42,
 'downloader/response_status_count/200': 42,
 'elapsed_time_seconds': 83.184645,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 6, 16, 28, 513185, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 20,
 'log_count/DEBUG': 597,
 'log_count/INFO': 1067,
 'memusage/max': 168652800,
 'memusage/startup': 147853312,
 'request_depth_max': 21,
 'response_received_count': 42,
 'scheduler/dequeued': 42,
 'scheduler/dequeued/memory': 42,
 'scheduler/enqueued': 42,
 'scheduler/enqueued/memory': 42,
 'scrape_type/batch_skipped': 514,
 'scrape_type/price_update': 20,
 'scrape_type/skipped': 149,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 42,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.983379712638756,
 'scrapy-zyte-api/mean_response_seconds': 3.1898531216152364,
 'scrapy-zyte-api/processed': 42,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 42,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 41,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 42,
 'scrapy-zyte-api/request_args/httpRequestBody': 1,
 'scrapy-zyte-api/request_args/httpRequestMethod': 1,
 'scrapy-zyte-api/request_args/httpResponseBody': 42,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 42,
 'scrapy-zyte-api/request_args/sessionContext': 40,
 'scrapy-zyte-api/request_args/url': 42,
 'scrapy-zyte-api/status_codes/200': 42,
 'scrapy-zyte-api/success': 42,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 683,
 'start_time': datetime.datetime(2026, 3, 29, 6, 15, 5, 328540, tzinfo=datetime.timezone.utc)}
2026-03-29 06:16:28 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 06:16:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe3006a0cd0>
2026-03-29 06:16:28 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7fe3006a2110>