2026-03-29 06:10:04 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 06:10:04 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 06:10:04 [motorway.uk] INFO: Batch mode enabled: batch 3/4
2026-03-29 06:10:04 [motorway.uk] INFO: Starting spider motorway.uk
2026-03-29 06:10:04 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 06:10:04 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 06:10:04 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 06:10:04 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 06:10:04 [scrapy.extensions.telnet] INFO: Telnet Password: 7bd329645437e0e8
2026-03-29 06:10:04 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 06:10:04 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/motorway.uk/task_4_2026-03-29T06_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 06:10:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:10:04 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 06:10:04 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 06:10:04 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 06:10:04 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 06:10:04 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-29 06:10:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 06:10:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-29 06:10:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 06:10:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 06:10:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 06:10:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 06:10:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 06:10:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 06:10:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 06:10:05 [scrapy.core.engine] INFO: Spider opened
2026-03-29 06:10:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 06:10:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 06:10:05 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-29 06:10:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:10:05 [scrapy-playwright] INFO: Starting download handler
2026-03-29 06:10:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://pro.motorway.co.uk/api/login> (referer: None) ['zyte-api']
2026-03-29 06:10:12 [motorway.uk] INFO: Scrapy-formatted cookies: [{'name': 'access-token', 'value': 'eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJ2ZXJzaW9uIjoyLCJpZCI6ODQyOSwibmFtZSI6IlNhbmogS3Jpc2huYXNhbXkiLCJlbWFpbCI6ImluZm9Ac2tkaXJlY3QuY28udWsiLCJmZWF0dXJlcyI6eyJzZWxsZXJCYW5rU3RhdGVtZW50Ijp0cnVlLCJTRUxMRVJfUkVFTlRSWSI6dHJ1ZSwiRE9DVU1FTlRTX1BST0dSRVNTSVZFX1VQTE9BRCI6dHJ1ZSwiZG9jdW1lbnRDYXB0dXJlVjIiOmZhbHNlLCJwYXltZW50c01WUCI6ZmFsc2UsInBheW1lbnRzSGlkZVNlbGxlckJhbmtEZXRhaWxzIjpmYWxzZSwicGF5bWVudHNLWUMiOmZhbHNlLCJwYXltZW50c012cFRyYW5zYWN0aW9uU3RhdGVtZW50Ijp0cnVlLCJwYXltZW50c0ZlZUNvbGxlY3Rpb24iOmZhbHNlfSwiaGFzSW52b2ljZUFjY2VzcyI6dHJ1ZSwicGhvbmUiOiIwNzc4NzU3ODIxMSIsIm90cFBob25lIjpudWxsLCJwaG9uZUNvbmZpcm1lZEF0IjpudWxsLCJkZWFsZXJOYW1lIjoiUyBLIERpcmVjdCIsImRlYWxlcklzVHJhZGUiOmZhbHNlLCJwcmltYXJ5Q29udGFjdCI6dHJ1ZSwiZGVhbGVySWQiOjgyMjMsImRlYWxlclN0YXR1cyI6eyJzbHVnIjoiaW5hY3RpdmUiLCJiaWRkaW5nRW5hYmxlZCI6dHJ1ZX0sImxhdGl0dWRlIjo1MS42MDE4MTkxLCJsb25naXR1ZGUiOi0wLjY3NzYxNTgsInBvc3Rjb2RlIjoiSFAxMDBOTiIsInBhcnRuZXJzIjpbXSwiaWRlbnRpdHkiOiJleUpoYkdjaU9pSklVekkxTmlJc0luUjVjQ0k2SWtwWFZDSjkuZXlKcFpHVnVkR2wwYVdWeklqcGJleUpwWkNJNk9EUXlPU3dpWlcxaGFXd2lPaUpwYm1adlFITnJaR2x5WldOMExtTnZMblZySWl3aWRIbHdaU0k2SW1SbFlXeGxjaUlzSW1WNGNHbHlaWE1pT2lJeU1ESTJMVEEwTFRJNFZEQTJPakV3T2pFeExqVTRNbG9pTENKd1lYSjBibVZ5Y3lJNlcxMTlYU3dpYVdGMElqb3hOemMwTnpZME5qRXhmUS5hVll5cEJTeW01ZVVzWlA4MWxySEg5akE5OUEwcXNYYzZfNjZGY0V5b1NJIiwiZGVhbGVyUGVybWlzc2lvbnMiOlsiaW52b2ljaW5nIiwia3ljIl0sInJlZnJlc2hUb2tlbiI6Ijg3NjdjNDU4NTJiYzc4ZTk3MTg0YmUzYWE0ODQxMzAwOWY2OWE2OTIzY2FlYzE2ODEzNzRmYjBkMGE5OWIwM2YiLCJkZWFsZXJUaWVyIjoic2VsZi1zZXJ2ZSIsImlzc3VlZEF0IjoxNzc0NzY0NjEyNDk4LCJpYXQiOjE3NzQ3NjQ2MTIsImV4cCI6MTc3NDc2NDkxMn0.hPmMFJFZzE2N9RtObj2LQFDexObMSf-wrgNgV_40XJI', 'domain': '.motorway.co.uk', 'path': '/'}]
2026-03-29 06:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk> (referer: https://pro.motorway.co.uk/api/login) ['zyte-api']
2026-03-29 06:10:14 [motorway.uk] INFO: Extracted Build ID: gL_OFaxoLv6tVLfo6F2-N
2026-03-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20453051
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20424412
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20454429
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 15889750
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715889750%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 15889750: 0
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 16345921
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20458811
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458811%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 20458811: 2
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20400912
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720400912%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 20400912: 0
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 19858821
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20189927
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20221411
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 11169122
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20452842
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 9060017
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 19270731
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 10602492
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20463841
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 17622892
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 18934020
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20161394
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 10368018
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 19820727
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 17578440
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717578440%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 17578440: 2
2026-03-29 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20363737
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 19767799
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20455931
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20431949
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20470382
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470382%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 20470382: 0
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20074687
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720074687%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 20074687: 0
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20212525
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20478200
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20407074
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 19745457
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20016365
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720016365%27 HTTP/1.1" 200 None
2026-03-29 06:10:15 [motorway.uk] INFO: Scrape type for 20016365: 2
2026-03-29 06:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:15 [motorway.uk] INFO: Found listing with ID: 20297201
2026-03-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720297201%27 HTTP/1.1" 200 None
2026-03-29 06:10:16 [motorway.uk] INFO: Scrape type for 20297201: 0
2026-03-29 06:10:16 [motorway.uk] INFO: Found listing with ID: 19667411
2026-03-29 06:10:16 [motorway.uk] INFO: Found listing with ID: 18790413
2026-03-29 06:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=36&page=1&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20147462
2026-03-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720147462%27 HTTP/1.1" 200 None
2026-03-29 06:10:17 [motorway.uk] INFO: Scrape type for 20147462: 0
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20434638
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20367180
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20464956
2026-03-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720464956%27 HTTP/1.1" 200 None
2026-03-29 06:10:17 [motorway.uk] INFO: Scrape type for 20464956: 0
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20443071
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 20452886
2026-03-29 06:10:17 [motorway.uk] INFO: Found listing with ID: 5358396
2026-03-29 06:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275358396%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 5358396: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20241454
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 19221106
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 9295088
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 19650674
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 19376449
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719376449%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 19376449: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20112110
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20214822
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20459184
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459184%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 20459184: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20407610
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 15164886
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20475188
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475188%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 20475188: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20418059
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20252490
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720252490%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 20252490: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 9771818
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 10242530
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20168105
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20477040
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 16698870
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 11407414
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20393118
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20275909
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 19848751
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719848751%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 19848751: 0
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20385637
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20448664
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 19949895
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20445658
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 16585471
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20394040
2026-03-29 06:10:18 [motorway.uk] INFO: Found listing with ID: 20474947
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474947%27 HTTP/1.1" 200 None
2026-03-29 06:10:18 [motorway.uk] INFO: Scrape type for 20474947: 0
2026-03-29 06:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17578440.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20016365.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e4c376b-6a14-5863-8f33-28928a8e6943 with identifier: 17578440
2026-03-29 06:10:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e4c376b-6a14-5863-8f33-28928a8e6943 with scrape type 2
2026-03-29 06:10:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e4c376b-6a14-5863-8f33-28928a8e6943 with scrape type 2
2026-03-29 06:10:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 8e4c376b-6a14-5863-8f33-28928a8e6943, identifier: 17578440
2026-03-29 06:10:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 8e4c376b-6a14-5863-8f33-28928a8e6943 with identifier: 17578440
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Grey HTTP/1.1" 200 None
2026-03-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 8e4c376b-6a14-5863-8f33-28928a8e6943 with identifier: 17578440
2026-03-29 06:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 8e4c376b-6a14-5863-8f33-28928a8e6943 with identifier: 17578440 to the API
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17578440.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '8e4c376b-6a14-5863-8f33-28928a8e6943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'HG24 XOA',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17578440',
 'listing': 'auction',
 'location': 'Dorset Poole',
 'make': 'Audi',
 'model': 'SQ2',
 'odometer': 14745,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 34790,
 'price_includes_vat': False,
 'registration_date': '2024-06-06',
 'seats_number': None,
 'seller_name': None,
 'title': 'Audi SQ2 Black ED TFSI Quat S-A',
 'transmission': 'automatic',
 'trim': 'Black ED TFSI Quat S-A',
 'vin': 'WAUZZZGA3RA063260',
 'year': 2024}
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717578440%27 HTTP/1.1" 200 None
2026-03-29 06:10:19 [motorway.uk] INFO: Saving data for 17578440: {'auction_closing_time': 1774798200.0, 'created_time': 1774296753.046329, 'last_price_update_time': 1774764619.646591}
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17578440') HTTP/1.1" 204 0
2026-03-29 06:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=72&page=2&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=buyItNow&loadedCount=0&page=0&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef7f7c19-8d0e-527b-a400-cfc83cd09792 with identifier: 20016365
2026-03-29 06:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef7f7c19-8d0e-527b-a400-cfc83cd09792 with scrape type 2
2026-03-29 06:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef7f7c19-8d0e-527b-a400-cfc83cd09792 with scrape type 2
2026-03-29 06:10:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: ef7f7c19-8d0e-527b-a400-cfc83cd09792, identifier: 20016365
2026-03-29 06:10:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: ef7f7c19-8d0e-527b-a400-cfc83cd09792 with identifier: 20016365
2026-03-29 06:10:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: ef7f7c19-8d0e-527b-a400-cfc83cd09792 with identifier: 20016365
2026-03-29 06:10:19 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: ef7f7c19-8d0e-527b-a400-cfc83cd09792 with identifier: 20016365 to the API
2026-03-29 06:10:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20016365.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'ef7f7c19-8d0e-527b-a400-cfc83cd09792',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'BC17 TWN',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20016365',
 'listing': 'auction',
 'location': 'Hampshire Southampton',
 'make': 'Abarth',
 'model': '695',
 'odometer': 48766,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9350,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seats_number': None,
 'seller_name': None,
 'title': 'Abarth 695 XSR Yamaha Limited Edition',
 'transmission': 'manual',
 'trim': 'XSR Yamaha Limited Edition',
 'vin': 'ZFA3120000J796903',
 'year': 2017}
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720016365%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Saving data for 20016365: {'auction_closing_time': 1774798200.0, 'created_time': 1774642258.06344, 'last_price_update_time': 1774764620.203786}
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20016365') HTTP/1.1" 204 0
2026-03-29 06:10:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458811.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 16616169
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20434660
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20470189
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 14203109
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 12358651
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20344294
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20456446
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720456446%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20456446: 0
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 18872056
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 16319557
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20335390
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20401093
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401093%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20401093: 2
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 5646787
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20475386
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 12732265
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20458325
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20144900
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 18836716
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718836716%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 18836716: 2
2026-03-29 06:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20467079
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467079%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20467079: 0
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 17846420
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717846420%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 17846420: 0
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20378816
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720378816%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20378816: 0
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20422486
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20475140
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 16685526
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20362782
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 10076837
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20459428
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20459174
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 17987243
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717987243%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 17987243: 2
2026-03-29 06:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 19896755
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 19556832
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719556832%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 19556832: 2
2026-03-29 06:10:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08570b57-50e5-55aa-adee-6861d8b3a41f with identifier: 20458811
2026-03-29 06:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08570b57-50e5-55aa-adee-6861d8b3a41f with scrape type 2
2026-03-29 06:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08570b57-50e5-55aa-adee-6861d8b3a41f with scrape type 2
2026-03-29 06:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 08570b57-50e5-55aa-adee-6861d8b3a41f, identifier: 20458811
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20471563
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471563%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20471563: 0
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 18952400
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20342551
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 18946726
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20459015
2026-03-29 06:10:20 [motorway.uk] INFO: Found listing with ID: 20381459
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720381459%27 HTTP/1.1" 200 None
2026-03-29 06:10:20 [motorway.uk] INFO: Scrape type for 20381459: 0
2026-03-29 06:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 08570b57-50e5-55aa-adee-6861d8b3a41f with identifier: 20458811
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Black HTTP/1.1" 200 None
2026-03-29 06:10:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-29 06:10:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 08570b57-50e5-55aa-adee-6861d8b3a41f with identifier: 20458811
2026-03-29 06:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 08570b57-50e5-55aa-adee-6861d8b3a41f with identifier: 20458811 to the API
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20458811.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Electric',
 'id': '08570b57-50e5-55aa-adee-6861d8b3a41f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WP23 DZE',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20458811',
 'listing': 'auction',
 'location': 'Greater London London',
 'make': 'Porsche',
 'model': 'Taycan',
 'odometer': 13128,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 58706,
 'price_includes_vat': False,
 'registration_date': '2023-06-21',
 'seats_number': None,
 'seller_name': None,
 'title': 'Porsche Taycan Turbo',
 'transmission': 'automatic',
 'trim': 'Turbo',
 'vin': 'WP0ZZZY15PSA50974',
 'year': 2023}
2026-03-29 06:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720458811%27 HTTP/1.1" 200 None
2026-03-29 06:10:21 [motorway.uk] INFO: Saving data for 20458811: {'auction_closing_time': 1774798200.0, 'created_time': 1774642986.785941, 'last_price_update_time': 1774764621.11265}
2026-03-29 06:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20458811') HTTP/1.1" 204 0
2026-03-29 06:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=108&page=3&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20460190
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 17470157
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20211194
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 19976195
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 12850662
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20471886
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20469032
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 17691777
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20457757
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20432964
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 17150490
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 18608681
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20475074
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20474326
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474326%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20474326: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20469573
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720469573%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20469573: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 18848020
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718848020%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 18848020: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20043252
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 9326734
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20476586
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 17218958
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717218958%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 17218958: 2
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20420409
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20331288
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720331288%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20331288: 2
2026-03-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 15130971
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20472698
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720472698%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20472698: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 15970869
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 15457276
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 19242415
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20290974
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720290974%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20290974: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 18072707
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 19634886
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 14828669
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20465098
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720465098%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 20465098: 0
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20415084
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 20297667
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 14900794
2026-03-29 06:10:22 [motorway.uk] INFO: Found listing with ID: 15271037
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715271037%27 HTTP/1.1" 200 None
2026-03-29 06:10:22 [motorway.uk] INFO: Scrape type for 15271037: 0
2026-03-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18836716.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59c2059c-c731-51c7-8f95-62d9d87ff65f with identifier: 18836716
2026-03-29 06:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59c2059c-c731-51c7-8f95-62d9d87ff65f with scrape type 2
2026-03-29 06:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59c2059c-c731-51c7-8f95-62d9d87ff65f with scrape type 2
2026-03-29 06:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 59c2059c-c731-51c7-8f95-62d9d87ff65f, identifier: 18836716
2026-03-29 06:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 59c2059c-c731-51c7-8f95-62d9d87ff65f with identifier: 18836716
2026-03-29 06:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Red HTTP/1.1" 200 None
2026-03-29 06:10:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 59c2059c-c731-51c7-8f95-62d9d87ff65f with identifier: 18836716
2026-03-29 06:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 59c2059c-c731-51c7-8f95-62d9d87ff65f with identifier: 18836716 to the API
2026-03-29 06:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/18836716.json>
{'auction_title': '',
 'category': None,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '59c2059c-c731-51c7-8f95-62d9d87ff65f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CX03 GEO',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/18836716',
 'listing': 'auction',
 'location': 'None None',
 'make': 'Audi',
 'model': 'Q2',
 'odometer': 62922,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9330,
 'price_includes_vat': False,
 'registration_date': '2017-11-20',
 'seats_number': None,
 'seller_name': None,
 'title': 'Audi Q2 Sport TFSI',
 'transmission': 'manual',
 'trim': 'Sport TFSI',
 'vin': 'WAUZZZGA6JA039362',
 'year': 2017}
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718836716%27 HTTP/1.1" 200 None
2026-03-29 06:10:24 [motorway.uk] INFO: Saving data for 18836716: {'auction_closing_time': 1774798200.0, 'created_time': 1774643301.178929, 'last_price_update_time': 1774764624.11957}
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='18836716') HTTP/1.1" 204 0
2026-03-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20401093.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=144&page=4&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 657293d9-f0d7-5936-b849-ac1c652b74d1 with identifier: 20401093
2026-03-29 06:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 657293d9-f0d7-5936-b849-ac1c652b74d1 with scrape type 2
2026-03-29 06:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 657293d9-f0d7-5936-b849-ac1c652b74d1 with scrape type 2
2026-03-29 06:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 657293d9-f0d7-5936-b849-ac1c652b74d1, identifier: 20401093
2026-03-29 06:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 657293d9-f0d7-5936-b849-ac1c652b74d1 with identifier: 20401093
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Blue HTTP/1.1" 200 None
2026-03-29 06:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 657293d9-f0d7-5936-b849-ac1c652b74d1 with identifier: 20401093
2026-03-29 06:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 657293d9-f0d7-5936-b849-ac1c652b74d1 with identifier: 20401093 to the API
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20401093.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '657293d9-f0d7-5936-b849-ac1c652b74d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LL18 CYC',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20401093',
 'listing': 'auction',
 'location': 'Essex Loughton',
 'make': 'Vauxhall',
 'model': 'Mokka',
 'odometer': 14643,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 10350,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Vauxhall Mokka X Active Turbo Auto',
 'transmission': 'automatic',
 'trim': 'X Active Turbo Auto',
 'vin': 'W0VJC7E86JB661448',
 'year': 2018}
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720401093%27 HTTP/1.1" 200 None
2026-03-29 06:10:24 [motorway.uk] INFO: Saving data for 20401093: {'auction_closing_time': 1774798200.0, 'created_time': 1774642316.593989, 'last_price_update_time': 1774764624.894743}
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20401093') HTTP/1.1" 204 0
2026-03-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17987243.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19556832.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 19310610
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 11270287
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711270287%27 HTTP/1.1" 200 None
2026-03-29 06:10:24 [motorway.uk] INFO: Scrape type for 11270287: 0
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 9113523
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 13162464
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 20443135
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 20487185
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 20344887
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720344887%27 HTTP/1.1" 200 None
2026-03-29 06:10:24 [motorway.uk] INFO: Scrape type for 20344887: 0
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 7838048
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277838048%27 HTTP/1.1" 200 None
2026-03-29 06:10:24 [motorway.uk] INFO: Scrape type for 7838048: 0
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 17832678
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 18981483
2026-03-29 06:10:24 [motorway.uk] INFO: Found listing with ID: 20195490
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720195490%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 20195490: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20439275
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720439275%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 20439275: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 18361170
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 17137303
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717137303%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 17137303: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 12962042
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 9644458
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 14735734
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20410706
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 18629843
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 15834331
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715834331%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 15834331: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 18751494
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20476604
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20401699
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 12496076
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712496076%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 12496076: 2
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 3045051
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273045051%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 3045051: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 19915046
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719915046%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 19915046: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 17416045
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 18560542
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718560542%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 18560542: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20382542
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20402616
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20266760
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20450634
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20475605
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 20207490
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 8640335
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278640335%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 8640335: 0
2026-03-29 06:10:25 [motorway.uk] INFO: Found listing with ID: 11768479
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711768479%27 HTTP/1.1" 200 None
2026-03-29 06:10:25 [motorway.uk] INFO: Scrape type for 11768479: 2
2026-03-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17218958.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46aae575-f02d-5a1b-af0d-58791ced0a46 with identifier: 17987243
2026-03-29 06:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46aae575-f02d-5a1b-af0d-58791ced0a46 with scrape type 2
2026-03-29 06:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46aae575-f02d-5a1b-af0d-58791ced0a46 with scrape type 2
2026-03-29 06:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 46aae575-f02d-5a1b-af0d-58791ced0a46, identifier: 17987243
2026-03-29 06:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79aff2fa-1d74-5ec2-8bce-048f7608f673 with identifier: 19556832
2026-03-29 06:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79aff2fa-1d74-5ec2-8bce-048f7608f673 with scrape type 2
2026-03-29 06:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 79aff2fa-1d74-5ec2-8bce-048f7608f673 with scrape type 2
2026-03-29 06:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 79aff2fa-1d74-5ec2-8bce-048f7608f673, identifier: 19556832
2026-03-29 06:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 46aae575-f02d-5a1b-af0d-58791ced0a46 with identifier: 17987243
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Silver HTTP/1.1" 200 None
2026-03-29 06:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-29 06:10:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 46aae575-f02d-5a1b-af0d-58791ced0a46 with identifier: 17987243
2026-03-29 06:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 46aae575-f02d-5a1b-af0d-58791ced0a46 with identifier: 17987243 to the API
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17987243.json>
{'auction_title': '',
 'category': None,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '46aae575-f02d-5a1b-af0d-58791ced0a46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BX22 TYD',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17987243',
 'listing': 'auction',
 'location': 'West Midlands Brierley Hill',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 44725,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9872,
 'price_includes_vat': False,
 'registration_date': '2022-08-11',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Transit Connect 220LEADER Eblu',
 'transmission': 'manual',
 'trim': 'Connect 220LEADER Eblu',
 'vin': 'WF0RXXWPGRNU64503',
 'year': 2022}
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717987243%27 HTTP/1.1" 200 None
2026-03-29 06:10:26 [motorway.uk] INFO: Saving data for 17987243: {'auction_closing_time': 1774798200.0, 'created_time': 1774642251.636179, 'last_price_update_time': 1774764626.042455}
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17987243') HTTP/1.1" 204 0
2026-03-29 06:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 79aff2fa-1d74-5ec2-8bce-048f7608f673 with identifier: 19556832
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid HTTP/1.1" 200 None
2026-03-29 06:10:26 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 79aff2fa-1d74-5ec2-8bce-048f7608f673 with identifier: 19556832
2026-03-29 06:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 79aff2fa-1d74-5ec2-8bce-048f7608f673 with identifier: 19556832 to the API
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19556832.json>
{'auction_title': '',
 'category': None,
 'color': 'Red',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.8L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Hybrid',
 'id': '79aff2fa-1d74-5ec2-8bce-048f7608f673',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'LL67 UGO',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19556832',
 'listing': 'auction',
 'location': 'Greater London Wembley',
 'make': 'Lexus',
 'model': 'CT 200',
 'odometer': 20100,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 14062,
 'price_includes_vat': False,
 'registration_date': '2017-12-05',
 'seats_number': None,
 'seller_name': None,
 'title': 'Lexus CT 200H Premier CVT',
 'transmission': 'automatic',
 'trim': 'H Premier CVT',
 'vin': 'JTHKD5BH802313152',
 'year': 2017}
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719556832%27 HTTP/1.1" 200 None
2026-03-29 06:10:26 [motorway.uk] INFO: Saving data for 19556832: {'auction_closing_time': 1774798200.0, 'created_time': 1774642467.688947, 'last_price_update_time': 1774764626.594196}
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19556832') HTTP/1.1" 204 0
2026-03-29 06:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20331288.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with identifier: 17218958
2026-03-29 06:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with scrape type 2
2026-03-29 06:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with scrape type 2
2026-03-29 06:10:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d9ec226b-ea6d-5f3a-a16d-a9820cf61259, identifier: 17218958
2026-03-29 06:10:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with identifier: 17218958
2026-03-29 06:10:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with identifier: 17218958
2026-03-29 06:10:26 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d9ec226b-ea6d-5f3a-a16d-a9820cf61259 with identifier: 17218958 to the API
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/17218958.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.4L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'd9ec226b-ea6d-5f3a-a16d-a9820cf61259',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LT67 XUX',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/17218958',
 'listing': 'auction',
 'location': 'Greater London Romford',
 'make': 'Vauxhall',
 'model': 'Zafira',
 'odometer': 67290,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 4153,
 'price_includes_vat': False,
 'registration_date': '2017-09-15',
 'seats_number': None,
 'seller_name': None,
 'title': 'Vauxhall Zafira Tourer SRI Turbo',
 'transmission': 'manual',
 'trim': 'Tourer SRI Turbo',
 'vin': 'W0VPD9EC7J1037431',
 'year': 2017}
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717218958%27 HTTP/1.1" 200 None
2026-03-29 06:10:27 [motorway.uk] INFO: Saving data for 17218958: {'auction_closing_time': 1774798200.0, 'created_time': 1774642875.964212, 'last_price_update_time': 1774764627.029834}
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='17218958') HTTP/1.1" 204 0
2026-03-29 06:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6af67f0-8e91-5b63-8192-50004ed7c86a with identifier: 20331288
2026-03-29 06:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6af67f0-8e91-5b63-8192-50004ed7c86a with scrape type 2
2026-03-29 06:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6af67f0-8e91-5b63-8192-50004ed7c86a with scrape type 2
2026-03-29 06:10:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: d6af67f0-8e91-5b63-8192-50004ed7c86a, identifier: 20331288
2026-03-29 06:10:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: d6af67f0-8e91-5b63-8192-50004ed7c86a with identifier: 20331288
2026-03-29 06:10:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: d6af67f0-8e91-5b63-8192-50004ed7c86a with identifier: 20331288
2026-03-29 06:10:27 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: d6af67f0-8e91-5b63-8192-50004ed7c86a with identifier: 20331288 to the API
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20331288.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '3.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'd6af67f0-8e91-5b63-8192-50004ed7c86a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'CA68 HXU',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20331288',
 'listing': 'auction',
 'location': 'Essex Grays',
 'make': 'Ford',
 'model': 'Ranger',
 'odometer': 98115,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 11903,
 'price_includes_vat': False,
 'registration_date': '2018-11-14',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Ranger Wildtrak 4X4 DCB TDCI A',
 'transmission': 'automatic',
 'trim': 'Wildtrak 4X4 DCB TDCI A',
 'vin': '6FPPXXMJ2PJP22053',
 'year': 2018}
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720331288%27 HTTP/1.1" 200 None
2026-03-29 06:10:27 [motorway.uk] INFO: Saving data for 20331288: {'auction_closing_time': 1774798200.0, 'created_time': 1774642310.784514, 'last_price_update_time': 1774764627.472813}
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20331288') HTTP/1.1" 204 0
2026-03-29 06:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=180&page=5&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20174885
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 14298754
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19348152
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20424865
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720424865%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20424865: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20464288
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 18852485
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 18303550
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20472974
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20315175
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20456097
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 7350923
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277350923%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 7350923: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19390538
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719390538%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 19390538: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 18829738
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20354482
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 15683124
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20394729
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720394729%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20394729: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20461741
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20375413
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720375413%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20375413: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 9334611
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279334611%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 9334611: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20077130
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20430282
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720430282%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20430282: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 9610716
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 14631572
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 18917393
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20219039
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720219039%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20219039: 0
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20460708
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19507165
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19989716
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20111851
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19625865
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20296846
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20408962
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 11715724
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19043845
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 19977278
2026-03-29 06:10:28 [motorway.uk] INFO: Found listing with ID: 20404977
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720404977%27 HTTP/1.1" 200 None
2026-03-29 06:10:28 [motorway.uk] INFO: Scrape type for 20404977: 0
2026-03-29 06:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=216&page=6&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19514188
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20161555
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 18026222
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20451099
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20449765
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720449765%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 20449765: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19430237
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20247436
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720247436%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 20247436: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 10157934
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20476838
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 16272859
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19669683
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20286133
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 11148596
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20338634
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20475599
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720475599%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 20475599: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19365234
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 3318153
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19741406
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719741406%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 19741406: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 18488953
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20373110
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 16534865
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716534865%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 16534865: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20445976
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20067826
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20334765
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 8863156
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%278863156%27 HTTP/1.1" 200 None
2026-03-29 06:10:30 [motorway.uk] INFO: Scrape type for 8863156: 0
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19295269
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 12082703
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20260906
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 14407439
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 19555734
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 16320818
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20226509
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 15621487
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 20473506
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 15508075
2026-03-29 06:10:30 [motorway.uk] INFO: Found listing with ID: 5756005
2026-03-29 06:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12496076.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40572575-7c11-518f-b3e8-a1889f0f389a with identifier: 12496076
2026-03-29 06:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40572575-7c11-518f-b3e8-a1889f0f389a with scrape type 2
2026-03-29 06:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40572575-7c11-518f-b3e8-a1889f0f389a with scrape type 2
2026-03-29 06:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 40572575-7c11-518f-b3e8-a1889f0f389a, identifier: 12496076
2026-03-29 06:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 40572575-7c11-518f-b3e8-a1889f0f389a with identifier: 12496076
2026-03-29 06:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 40572575-7c11-518f-b3e8-a1889f0f389a with identifier: 12496076
2026-03-29 06:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 40572575-7c11-518f-b3e8-a1889f0f389a with identifier: 12496076 to the API
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/12496076.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '40572575-7c11-518f-b3e8-a1889f0f389a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'FN74 LNE',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/12496076',
 'listing': 'auction',
 'location': 'Cheshire East Sandbach',
 'make': 'Volkswagen',
 'model': 'Transporter',
 'odometer': 11350,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 28420,
 'price_includes_vat': False,
 'registration_date': '2024-09-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Volkswagen Transporter T28 Startline TDI',
 'transmission': 'manual',
 'trim': 'T28 Startline TDI',
 'vin': 'WV1ZZZ7H2RX032908',
 'year': 2024}
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712496076%27 HTTP/1.1" 200 None
2026-03-29 06:10:31 [motorway.uk] INFO: Saving data for 12496076: {'auction_closing_time': 1774798200.0, 'created_time': 1774642532.33226, 'last_price_update_time': 1774764631.019793}
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='12496076') HTTP/1.1" 204 0
2026-03-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11768479.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=252&page=7&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with identifier: 11768479
2026-03-29 06:10:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with scrape type 2
2026-03-29 06:10:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with scrape type 2
2026-03-29 06:10:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 313554ba-5eb6-5655-9ea6-14c73b3e3f86, identifier: 11768479
2026-03-29 06:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with identifier: 11768479
2026-03-29 06:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with identifier: 11768479
2026-03-29 06:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 313554ba-5eb6-5655-9ea6-14c73b3e3f86 with identifier: 11768479 to the API
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/11768479.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.1L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '313554ba-5eb6-5655-9ea6-14c73b3e3f86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'W1 JBD',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/11768479',
 'listing': 'auction',
 'location': 'South Yorkshire Rotherham',
 'make': 'Mercedes',
 'model': 'V Class',
 'odometer': 108640,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 23003,
 'price_includes_vat': False,
 'registration_date': '2017-01-04',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mercedes V250 Sport Bluetec Auto',
 'transmission': 'automatic',
 'trim': 'V250 Sport Bluetec Auto',
 'vin': 'WDF44781123248645',
 'year': 2017}
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2711768479%27 HTTP/1.1" 200 None
2026-03-29 06:10:31 [motorway.uk] INFO: Saving data for 11768479: {'auction_closing_time': 1774798200.0, 'created_time': 1774643555.53286, 'last_price_update_time': 1774764631.993574}
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='11768479') HTTP/1.1" 204 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 18388032
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 13473049
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20461730
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 18372204
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 16005095
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 15122914
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19793325
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20309629
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 9379665
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279379665%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 9379665: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 17970231
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19902225
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20220920
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20018740
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19776443
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20444808
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19723131
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19868174
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20462890
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20471245
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20379565
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19778480
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20356719
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720356719%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 20356719: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20105918
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 6878005
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 9380986
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20180237
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 16956632
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716956632%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 16956632: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20230648
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720230648%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 20230648: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20442136
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 19122214
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719122214%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 19122214: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20250168
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20360643
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 7497534
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20291186
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 20476783
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720476783%27 HTTP/1.1" 200 None
2026-03-29 06:10:32 [motorway.uk] INFO: Scrape type for 20476783: 0
2026-03-29 06:10:32 [motorway.uk] INFO: Found listing with ID: 8035510
2026-03-29 06:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=288&page=8&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20389051
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 14132049
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20266972
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20470887
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 19231087
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719231087%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 19231087: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 17206340
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20453641
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 19648721
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 13711120
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 6061364
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20467571
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 16932861
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 16337094
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20279234
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20310408
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20473711
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473711%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 20473711: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 19627347
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 16854289
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 18257606
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718257606%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 18257606: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 13451992
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20453903
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20131872
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20272549
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 15758012
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 19310694
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719310694%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 19310694: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20473706
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 16417060
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 4941184
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%274941184%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 4941184: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20368484
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720368484%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 20368484: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 2300054
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%272300054%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 2300054: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 6271057
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%276271057%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 6271057: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20165611
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 11539399
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20441488
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 20467601
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467601%27 HTTP/1.1" 200 None
2026-03-29 06:10:33 [motorway.uk] INFO: Scrape type for 20467601: 0
2026-03-29 06:10:33 [motorway.uk] INFO: Found listing with ID: 9051717
2026-03-29 06:10:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=324&page=9&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 9752236
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 3894223
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273894223%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 3894223: 2
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20457087
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 15766321
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 16712991
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716712991%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 16712991: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20254081
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254081%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 20254081: 2
2026-03-29 06:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20455561
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20342759
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20474399
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 19081062
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20473913
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473913%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 20473913: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20419308
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20389211
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20472427
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720472427%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 20472427: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20470626
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 14890152
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 18462191
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 17876387
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717876387%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 17876387: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20391858
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 19333245
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 7488696
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277488696%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 7488696: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 19986865
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 16484532
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20408325
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720408325%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 20408325: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20179240
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 13765540
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 17076457
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20405382
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20332192
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720332192%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 20332192: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20475400
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 1639917
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271639917%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 1639917: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 18991011
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20466183
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 18479232
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2718479232%27 HTTP/1.1" 200 None
2026-03-29 06:10:34 [motorway.uk] INFO: Scrape type for 18479232: 0
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 19605478
2026-03-29 06:10:34 [motorway.uk] INFO: Found listing with ID: 20361020
2026-03-29 06:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=360&page=10&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20471470
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720471470%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 20471470: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20343152
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 19737512
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 17592195
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717592195%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 17592195: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20455379
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720455379%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 20455379: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 7102372
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277102372%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 7102372: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20340723
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 9859136
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 12142270
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 19096344
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719096344%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 19096344: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20101792
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20231542
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 16313324
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20471336
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20407422
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20300321
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20350333
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 17904698
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20343098
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20388448
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20463004
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20391563
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20464938
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 18741821
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20279144
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 9771799
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279771799%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 9771799: 0
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20366934
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20347498
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 17557803
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20316360
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720316360%27 HTTP/1.1" 200 None
2026-03-29 06:10:35 [motorway.uk] INFO: Scrape type for 20316360: 2
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 19220082
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 6255978
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20454459
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20416980
2026-03-29 06:10:35 [motorway.uk] INFO: Found listing with ID: 20357566
2026-03-29 06:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720357566%27 HTTP/1.1" 200 None
2026-03-29 06:10:36 [motorway.uk] INFO: Scrape type for 20357566: 0
2026-03-29 06:10:36 [motorway.uk] INFO: Found listing with ID: 20467996
2026-03-29 06:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720467996%27 HTTP/1.1" 200 None
2026-03-29 06:10:36 [motorway.uk] INFO: Scrape type for 20467996: 0
2026-03-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=396&page=11&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 16845807
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716845807%27 HTTP/1.1" 200 None
2026-03-29 06:10:37 [motorway.uk] INFO: Scrape type for 16845807: 2
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 16400774
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20373105
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19370870
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19885907
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20086616
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 8548948
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20453293
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20366333
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19052366
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 18610915
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20474573
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720474573%27 HTTP/1.1" 200 None
2026-03-29 06:10:37 [motorway.uk] INFO: Scrape type for 20474573: 0
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20363171
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720363171%27 HTTP/1.1" 200 None
2026-03-29 06:10:37 [motorway.uk] INFO: Scrape type for 20363171: 0
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19674536
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20199957
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20454873
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 15388563
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 14183290
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20110750
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20220593
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20471175
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20219769
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20318300
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20267440
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720267440%27 HTTP/1.1" 200 None
2026-03-29 06:10:37 [motorway.uk] INFO: Scrape type for 20267440: 0
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 8580676
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20404892
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 6628569
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20395141
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 17937377
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 18039395
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20131379
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720131379%27 HTTP/1.1" 200 None
2026-03-29 06:10:37 [motorway.uk] INFO: Scrape type for 20131379: 0
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 2695619
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19337514
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 19281948
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 20212581
2026-03-29 06:10:37 [motorway.uk] INFO: Found listing with ID: 12347784
2026-03-29 06:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3894223.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=432&page=12&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69c54b19-9751-5135-a97c-4a8021df8b92 with identifier: 3894223
2026-03-29 06:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69c54b19-9751-5135-a97c-4a8021df8b92 with scrape type 2
2026-03-29 06:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69c54b19-9751-5135-a97c-4a8021df8b92 with scrape type 2
2026-03-29 06:10:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69c54b19-9751-5135-a97c-4a8021df8b92, identifier: 3894223
2026-03-29 06:10:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69c54b19-9751-5135-a97c-4a8021df8b92 with identifier: 3894223
2026-03-29 06:10:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69c54b19-9751-5135-a97c-4a8021df8b92 with identifier: 3894223
2026-03-29 06:10:38 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69c54b19-9751-5135-a97c-4a8021df8b92 with identifier: 3894223 to the API
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/3894223.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '3.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '69c54b19-9751-5135-a97c-4a8021df8b92',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'LL17 CYY',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/3894223',
 'listing': 'auction',
 'location': 'Greater London London',
 'make': 'Audi',
 'model': 'A8',
 'odometer': 73000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 12853,
 'price_includes_vat': False,
 'registration_date': '2017-07-13',
 'seats_number': None,
 'seller_name': None,
 'title': 'Audi A8 SE Exec TDI Quattro Auto',
 'transmission': 'automatic',
 'trim': 'SE Exec TDI Quattro Auto',
 'vin': 'WAUZZZ4H0HN013926',
 'year': 2017}
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%273894223%27 HTTP/1.1" 200 None
2026-03-29 06:10:38 [motorway.uk] INFO: Saving data for 3894223: {'auction_closing_time': 1774798200.0, 'created_time': 1774642879.658405, 'last_price_update_time': 1774764638.890631}
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='3894223') HTTP/1.1" 204 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20196170
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20469645
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 18070489
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20413892
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20262525
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19991580
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20397299
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720397299%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 20397299: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20172330
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720172330%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 20172330: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20098206
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19917549
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20421278
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 17970165
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19570710
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 9130362
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19807649
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719807649%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 19807649: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 17253097
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20361949
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20470085
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 17800051
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20473970
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473970%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 20473970: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20366562
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20031019
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19861655
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20441604
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720441604%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 20441604: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20463099
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19510740
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719510740%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 19510740: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20402747
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20429067
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19475854
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 15978781
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715978781%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 15978781: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 13033778
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 20026360
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19775049
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 18362922
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19155544
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719155544%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 19155544: 0
2026-03-29 06:10:39 [motorway.uk] INFO: Found listing with ID: 19093843
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719093843%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Scrape type for 19093843: 0
2026-03-29 06:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20316360.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20254081.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with identifier: 20316360
2026-03-29 06:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with scrape type 2
2026-03-29 06:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with scrape type 2
2026-03-29 06:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 39aa0a8a-26f0-5fb1-afe5-c392eb529e64, identifier: 20316360
2026-03-29 06:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with identifier: 20316360
2026-03-29 06:10:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with identifier: 20316360
2026-03-29 06:10:39 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 39aa0a8a-26f0-5fb1-afe5-c392eb529e64 with identifier: 20316360 to the API
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20316360.json>
{'auction_title': '',
 'category': None,
 'color': 'Silver',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.6L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '39aa0a8a-26f0-5fb1-afe5-c392eb529e64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'SD17 PYP',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20316360',
 'listing': 'auction',
 'location': 'Stirling Glasgow',
 'make': 'Peugeot',
 'model': 'Horizon',
 'odometer': 28252,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 6901,
 'price_includes_vat': False,
 'registration_date': '2017-07-21',
 'seats_number': None,
 'seller_name': None,
 'title': 'Peugeot Horizon RE',
 'transmission': 'manual',
 'trim': 'RE',
 'vin': 'VF37JBHY6HJ590212',
 'year': 2017}
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720316360%27 HTTP/1.1" 200 None
2026-03-29 06:10:39 [motorway.uk] INFO: Saving data for 20316360: {'auction_closing_time': 1774798200.0, 'created_time': 1774643298.653951, 'last_price_update_time': 1774764639.750708}
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20316360') HTTP/1.1" 204 0
2026-03-29 06:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46c3126e-b6f4-5a95-8886-f6163b466a16 with identifier: 20254081
2026-03-29 06:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46c3126e-b6f4-5a95-8886-f6163b466a16 with scrape type 2
2026-03-29 06:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46c3126e-b6f4-5a95-8886-f6163b466a16 with scrape type 2
2026-03-29 06:10:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 46c3126e-b6f4-5a95-8886-f6163b466a16, identifier: 20254081
2026-03-29 06:10:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 46c3126e-b6f4-5a95-8886-f6163b466a16 with identifier: 20254081
2026-03-29 06:10:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=White HTTP/1.1" 200 None
2026-03-29 06:10:40 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 06:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 46c3126e-b6f4-5a95-8886-f6163b466a16 with identifier: 20254081
2026-03-29 06:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 46c3126e-b6f4-5a95-8886-f6163b466a16 with identifier: 20254081 to the API
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20254081.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '46c3126e-b6f4-5a95-8886-f6163b466a16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'DV17 JUA',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20254081',
 'listing': 'auction',
 'location': 'Suffolk Stowmarket',
 'make': 'Volkswagen',
 'model': 'Transporter',
 'odometer': 145000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 9943,
 'price_includes_vat': False,
 'registration_date': '2017-05-26',
 'seats_number': None,
 'seller_name': None,
 'title': 'Volkswagen Transporter T32 ST-LN TDI BMT',
 'transmission': 'manual',
 'trim': 'T32 ST-LN TDI BMT',
 'vin': 'WV1ZZZ7HZHH146535',
 'year': 2017}
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720254081%27 HTTP/1.1" 200 None
2026-03-29 06:10:40 [motorway.uk] INFO: Saving data for 20254081: {'auction_closing_time': 1774798200.0, 'created_time': 1774643255.603116, 'last_price_update_time': 1774764640.434781}
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20254081') HTTP/1.1" 204 0
2026-03-29 06:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16845807.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7000d7c2-7102-5715-9130-f87f8d0b08c2 with identifier: 16845807
2026-03-29 06:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7000d7c2-7102-5715-9130-f87f8d0b08c2 with scrape type 2
2026-03-29 06:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7000d7c2-7102-5715-9130-f87f8d0b08c2 with scrape type 2
2026-03-29 06:10:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7000d7c2-7102-5715-9130-f87f8d0b08c2, identifier: 16845807
2026-03-29 06:10:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7000d7c2-7102-5715-9130-f87f8d0b08c2 with identifier: 16845807
2026-03-29 06:10:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7000d7c2-7102-5715-9130-f87f8d0b08c2 with identifier: 16845807
2026-03-29 06:10:40 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7000d7c2-7102-5715-9130-f87f8d0b08c2 with identifier: 16845807 to the API
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/16845807.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.5L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Hybrid',
 'id': '7000d7c2-7102-5715-9130-f87f8d0b08c2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'S80 NRD',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/16845807',
 'listing': 'auction',
 'location': 'Stockton-on-Tees Yarm',
 'make': 'Lexus',
 'model': 'NX 300',
 'odometer': 81624,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 11047,
 'price_includes_vat': False,
 'registration_date': '2015-07-31',
 'seats_number': None,
 'seller_name': None,
 'title': 'Lexus NX 300H F Sport CVT',
 'transmission': 'automatic',
 'trim': 'H F Sport CVT',
 'vin': 'JTJBJRBZ702021709',
 'year': 2015}
2026-03-29 06:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716845807%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Saving data for 16845807: {'auction_closing_time': 1774798200.0, 'created_time': 1774643316.461341, 'last_price_update_time': 1774764641.00329}
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='16845807') HTTP/1.1" 204 0
2026-03-29 06:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=468&page=13&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 16513638
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716513638%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 16513638: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19222213
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719222213%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 19222213: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 14988665
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19925838
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925838%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 19925838: 2
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20127776
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19866142
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20350830
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20065381
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19121190
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20469777
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 10469814
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20342588
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19246820
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20235127
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720235127%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 20235127: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20469374
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 13284537
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2713284537%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 13284537: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 15736589
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 18911907
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20440317
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20387515
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720387515%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 20387515: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 16182811
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20238382
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720238382%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 20238382: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 19954553
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719954553%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 19954553: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 14335353
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20389632
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 17183075
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 17766139
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 18827095
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 15165987
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715165987%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 15165987: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 6574407
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20250456
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20391180
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 6111493
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20470936
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470936%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 20470936: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20427924
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720427924%27 HTTP/1.1" 200 None
2026-03-29 06:10:41 [motorway.uk] INFO: Scrape type for 20427924: 0
2026-03-29 06:10:41 [motorway.uk] INFO: Found listing with ID: 20472901
2026-03-29 06:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=504&page=14&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20274978
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19424427
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20459782
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720459782%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 20459782: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 16464746
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19250312
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20472778
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720472778%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 20472778: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 881696
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20440012
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20443168
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 16100448
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716100448%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 16100448: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20366498
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20466645
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720466645%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 20466645: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 13582420
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 11628897
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 5520581
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20447988
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20288290
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20427489
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20252853
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720252853%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 20252853: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19086772
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19622244
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20420787
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20467849
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 8685990
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19099521
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 18276303
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 15957419
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715957419%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 15957419: 2
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 5137777
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20277289
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19894031
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20380265
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19808818
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719808818%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 19808818: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 19088331
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20475870
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 20021231
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720021231%27 HTTP/1.1" 200 None
2026-03-29 06:10:42 [motorway.uk] INFO: Scrape type for 20021231: 0
2026-03-29 06:10:42 [motorway.uk] INFO: Found listing with ID: 9756607
2026-03-29 06:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:42 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=540&page=15&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20360457
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 9767952
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 16453749
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20039733
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720039733%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 20039733: 0
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 6988274
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20353328
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 9261606
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20460986
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460986%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 20460986: 2
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 17932889
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717932889%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 17932889: 0
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20460256
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460256%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 20460256: 0
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20407283
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20471112
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 17989976
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20475208
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 9487324
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 15564979
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19215504
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 18063263
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19578369
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 16932806
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19918647
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719918647%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 19918647: 0
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 1809812
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271809812%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 1809812: 2
2026-03-29 06:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 4787934
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20428964
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20413909
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 14252223
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714252223%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 14252223: 0
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19777443
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19551479
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20459100
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19963155
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 20472366
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 19700534
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 14847848
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 10460674
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710460674%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 10460674: 2
2026-03-29 06:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19925838.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 12755614
2026-03-29 06:10:43 [motorway.uk] INFO: Found listing with ID: 10406829
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710406829%27 HTTP/1.1" 200 None
2026-03-29 06:10:43 [motorway.uk] INFO: Scrape type for 10406829: 0
2026-03-29 06:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66377420-e19b-5dce-a271-719f70a39cdd with identifier: 19925838
2026-03-29 06:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66377420-e19b-5dce-a271-719f70a39cdd with scrape type 2
2026-03-29 06:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66377420-e19b-5dce-a271-719f70a39cdd with scrape type 2
2026-03-29 06:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 66377420-e19b-5dce-a271-719f70a39cdd, identifier: 19925838
2026-03-29 06:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 66377420-e19b-5dce-a271-719f70a39cdd with identifier: 19925838
2026-03-29 06:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 66377420-e19b-5dce-a271-719f70a39cdd with identifier: 19925838
2026-03-29 06:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 66377420-e19b-5dce-a271-719f70a39cdd with identifier: 19925838 to the API
2026-03-29 06:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19925838.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '66377420-e19b-5dce-a271-719f70a39cdd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'MT21 DHG',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19925838',
 'listing': 'auction',
 'location': 'West Midlands Wolverhampton',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 79380,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 4581,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seats_number': None,
 'seller_name': None,
 'title': 'Citroen C3 Shine + PureTech S/S',
 'transmission': 'manual',
 'trim': 'Shine + PureTech S/S',
 'vin': 'VF7SXHMRVMT513759',
 'year': 2021}
2026-03-29 06:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719925838%27 HTTP/1.1" 200 None
2026-03-29 06:10:44 [motorway.uk] INFO: Saving data for 19925838: {'auction_closing_time': 1774798200.0, 'created_time': 1774642436.240022, 'last_price_update_time': 1774764644.197904}
2026-03-29 06:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19925838') HTTP/1.1" 204 0
2026-03-29 06:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=576&page=16&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20457275
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457275%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20457275: 2
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 4427220
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20459194
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20475878
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20334682
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720334682%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20334682: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20425372
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720425372%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20425372: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 17114477
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20461914
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720461914%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20461914: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 19622834
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20360461
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20122733
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20236371
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20000790
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20474416
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20467523
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20388608
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20465341
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20467731
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 19933908
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20177902
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20476031
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 16667338
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 14174433
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20175164
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 19536345
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20472455
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720472455%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20472455: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20458967
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20473093
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 17151245
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 9468463
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%279468463%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 9468463: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 6574245
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20356418
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20233857
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 20315816
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720315816%27 HTTP/1.1" 200 None
2026-03-29 06:10:45 [motorway.uk] INFO: Scrape type for 20315816: 0
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 167780
2026-03-29 06:10:45 [motorway.uk] INFO: Found listing with ID: 19703945
2026-03-29 06:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10460674.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: edfc7606-f762-5133-9171-79e9fc8fab8b with identifier: 10460674
2026-03-29 06:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item edfc7606-f762-5133-9171-79e9fc8fab8b with scrape type 2
2026-03-29 06:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item edfc7606-f762-5133-9171-79e9fc8fab8b with scrape type 2
2026-03-29 06:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: edfc7606-f762-5133-9171-79e9fc8fab8b, identifier: 10460674
2026-03-29 06:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: edfc7606-f762-5133-9171-79e9fc8fab8b with identifier: 10460674
2026-03-29 06:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: edfc7606-f762-5133-9171-79e9fc8fab8b with identifier: 10460674
2026-03-29 06:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: edfc7606-f762-5133-9171-79e9fc8fab8b with identifier: 10460674 to the API
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/10460674.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.2L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'edfc7606-f762-5133-9171-79e9fc8fab8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'ND17 TXZ',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/10460674',
 'listing': 'auction',
 'location': 'East Lothian Council Prestonpans',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 67796,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 2893,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seats_number': None,
 'seller_name': None,
 'title': 'Peugeot 308 Active S/S',
 'transmission': 'manual',
 'trim': 'Active S/S',
 'vin': 'VF3LPHNYHHS156614',
 'year': 2017}
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2710460674%27 HTTP/1.1" 200 None
2026-03-29 06:10:46 [motorway.uk] INFO: Saving data for 10460674: {'auction_closing_time': 1774798200.0, 'created_time': 1774643560.362332, 'last_price_update_time': 1774764646.846217}
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='10460674') HTTP/1.1" 204 0
2026-03-29 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1809812.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=612&page=17&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with identifier: 1809812
2026-03-29 06:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with scrape type 2
2026-03-29 06:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with scrape type 2
2026-03-29 06:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: b4b088d3-ea8c-5896-ad0d-77778d9f2ec5, identifier: 1809812
2026-03-29 06:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with identifier: 1809812
2026-03-29 06:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with identifier: 1809812
2026-03-29 06:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: b4b088d3-ea8c-5896-ad0d-77778d9f2ec5 with identifier: 1809812 to the API
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/1809812.json>
{'auction_title': '',
 'category': None,
 'color': 'Black',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'b4b088d3-ea8c-5896-ad0d-77778d9f2ec5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'B333 GSC',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/1809812',
 'listing': 'auction',
 'location': 'Highland Dingwall',
 'make': 'Honda',
 'model': 'Civic',
 'odometer': 55000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 7450,
 'price_includes_vat': False,
 'registration_date': '2018-03-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Honda Civic SE VTEC',
 'transmission': 'manual',
 'trim': 'SE VTEC',
 'vin': 'SHHFK6740HU019278',
 'year': 2018}
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%271809812%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Saving data for 1809812: {'auction_closing_time': 1774798200.0, 'created_time': 1774471219.187395, 'last_price_update_time': 1774764647.486809}
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='1809812') HTTP/1.1" 204 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 17533899
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19672096
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20091960
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20285041
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720285041%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 20285041: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20249930
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 7475704
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%277475704%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 7475704: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20335518
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720335518%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 20335518: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19362793
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19659928
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20426705
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20190784
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720190784%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 20190784: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 16807098
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2716807098%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 16807098: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20384128
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20439775
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 5379551
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%275379551%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 5379551: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19543949
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19286603
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20465107
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20242691
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20203882
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 15811586
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715811586%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 15811586: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20405732
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720405732%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 20405732: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19668967
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20113593
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20407661
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19998115
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998115%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 19998115: 2
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20146343
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 14161948
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2714161948%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 14161948: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 19936942
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20451036
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20330355
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 15201909
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715201909%27 HTTP/1.1" 200 None
2026-03-29 06:10:47 [motorway.uk] INFO: Scrape type for 15201909: 0
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20286221
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20428995
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20249251
2026-03-29 06:10:47 [motorway.uk] INFO: Found listing with ID: 20472915
2026-03-29 06:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457275.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with identifier: 20457275
2026-03-29 06:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with scrape type 2
2026-03-29 06:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with scrape type 2
2026-03-29 06:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 05d4530e-b86e-5731-b8dd-1f5eeb4bef76, identifier: 20457275
2026-03-29 06:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with identifier: 20457275
2026-03-29 06:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with identifier: 20457275
2026-03-29 06:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 05d4530e-b86e-5731-b8dd-1f5eeb4bef76 with identifier: 20457275 to the API
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20457275.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.6L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '05d4530e-b86e-5731-b8dd-1f5eeb4bef76',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VK16 ZPR',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20457275',
 'listing': 'auction',
 'location': 'Cumbria Askam-in-Furness',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 78000,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 5205,
 'price_includes_vat': False,
 'registration_date': '2016-04-12',
 'seats_number': None,
 'seller_name': None,
 'title': 'Nissan Qashqai Tekna DiG-T',
 'transmission': 'manual',
 'trim': 'Tekna DiG-T',
 'vin': 'SJNFCAJ11U1680762',
 'year': 2016}
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720457275%27 HTTP/1.1" 200 None
2026-03-29 06:10:48 [motorway.uk] INFO: Saving data for 20457275: {'auction_closing_time': 1774798200.0, 'created_time': 1774643362.917694, 'last_price_update_time': 1774764648.8243}
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20457275') HTTP/1.1" 204 0
2026-03-29 06:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15957419.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/api/vehicle/list?listType=auction&loadedCount=648&page=18&sort=recommended&order=DESC&recommendedSortOrderVersion=v1> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 669f959e-3c4d-5b5e-9515-9611e5b81287 with identifier: 15957419
2026-03-29 06:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 669f959e-3c4d-5b5e-9515-9611e5b81287 with scrape type 2
2026-03-29 06:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 669f959e-3c4d-5b5e-9515-9611e5b81287 with scrape type 2
2026-03-29 06:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 669f959e-3c4d-5b5e-9515-9611e5b81287, identifier: 15957419
2026-03-29 06:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 669f959e-3c4d-5b5e-9515-9611e5b81287 with identifier: 15957419
2026-03-29 06:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 669f959e-3c4d-5b5e-9515-9611e5b81287 with identifier: 15957419
2026-03-29 06:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 669f959e-3c4d-5b5e-9515-9611e5b81287 with identifier: 15957419 to the API
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/15957419.json>
{'auction_title': '',
 'category': None,
 'color': 'Grey',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.6L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': '669f959e-3c4d-5b5e-9515-9611e5b81287',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'EK58 TWM',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/15957419',
 'listing': 'auction',
 'location': 'Wiltshire Salisbury',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 77874,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 1675,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Fiesta Titanium 120',
 'transmission': 'manual',
 'trim': 'Titanium 120',
 'vin': 'WF0JXXGAJJ8Y03094',
 'year': 2008}
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2715957419%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Saving data for 15957419: {'auction_closing_time': 1774798200.0, 'created_time': 1774643534.49605, 'last_price_update_time': 1774764649.54693}
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='15957419') HTTP/1.1" 204 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20473376
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720473376%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20473376: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20292229
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20435979
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20391868
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20330745
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20448027
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720448027%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20448027: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 18590459
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 19075996
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719075996%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 19075996: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20380694
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20457911
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20463932
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20470621
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720470621%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20470621: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 19784782
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 11288581
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 19768875
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20394436
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20414221
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414221%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20414221: 2
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20438780
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20069102
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720069102%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20069102: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 17975819
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2717975819%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 17975819: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20397268
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20469112
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 12376286
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2712376286%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 12376286: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20174154
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20406035
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20324057
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20460902
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 5468449
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 18606457
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20428940
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720428940%27 HTTP/1.1" 200 None
2026-03-29 06:10:49 [motorway.uk] INFO: Scrape type for 20428940: 0
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20433844
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 19472834
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 19999834
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20445876
2026-03-29 06:10:49 [motorway.uk] INFO: Found listing with ID: 20382047
2026-03-29 06:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 06:10:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19998115.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bab6ee9b-a738-5a03-abf4-52e6c2251e56 with identifier: 19998115
2026-03-29 06:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bab6ee9b-a738-5a03-abf4-52e6c2251e56 with scrape type 2
2026-03-29 06:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bab6ee9b-a738-5a03-abf4-52e6c2251e56 with scrape type 2
2026-03-29 06:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: bab6ee9b-a738-5a03-abf4-52e6c2251e56, identifier: 19998115
2026-03-29 06:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: bab6ee9b-a738-5a03-abf4-52e6c2251e56 with identifier: 19998115
2026-03-29 06:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: bab6ee9b-a738-5a03-abf4-52e6c2251e56 with identifier: 19998115
2026-03-29 06:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: bab6ee9b-a738-5a03-abf4-52e6c2251e56 with identifier: 19998115 to the API
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/19998115.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '1.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'bab6ee9b-a738-5a03-abf4-52e6c2251e56',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'TW12 AMY',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/19998115',
 'listing': 'auction',
 'location': 'Stirling Stirling',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 87246,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 1826,
 'price_includes_vat': False,
 'registration_date': '2016-09-01',
 'seats_number': None,
 'seller_name': None,
 'title': 'Ford Fiesta Zetec Turbo',
 'transmission': 'manual',
 'trim': 'Zetec Turbo',
 'vin': 'WF0DXXGAKDGK00857',
 'year': 2016}
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2719998115%27 HTTP/1.1" 200 None
2026-03-29 06:10:50 [motorway.uk] INFO: Saving data for 19998115: {'auction_closing_time': 1774798200.0, 'created_time': 1774643536.437476, 'last_price_update_time': 1774764650.676394}
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='19998115') HTTP/1.1" 204 0
2026-03-29 06:10:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414221.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d1bee57-a191-5a41-a686-34f1d5035971 with identifier: 20414221
2026-03-29 06:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d1bee57-a191-5a41-a686-34f1d5035971 with scrape type 2
2026-03-29 06:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d1bee57-a191-5a41-a686-34f1d5035971 with scrape type 2
2026-03-29 06:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 7d1bee57-a191-5a41-a686-34f1d5035971, identifier: 20414221
2026-03-29 06:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 7d1bee57-a191-5a41-a686-34f1d5035971 with identifier: 20414221
2026-03-29 06:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 7d1bee57-a191-5a41-a686-34f1d5035971 with identifier: 20414221
2026-03-29 06:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 7d1bee57-a191-5a41-a686-34f1d5035971 with identifier: 20414221 to the API
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20414221.json>
{'auction_title': '',
 'category': None,
 'color': 'White',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.1L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '7d1bee57-a191-5a41-a686-34f1d5035971',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HG62 ORF',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20414221',
 'listing': 'auction',
 'location': 'Plymouth Plymouth',
 'make': 'Mercedes',
 'model': 'C Class',
 'odometer': 119695,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 2658,
 'price_includes_vat': False,
 'registration_date': '2012-11-30',
 'seats_number': None,
 'seller_name': None,
 'title': 'Mercedes C250 AMG Sport CDI BlueEFFICIENCY A',
 'transmission': 'automatic',
 'trim': 'C250 AMG Sport CDI BlueEFFICIENCY A',
 'vin': 'WDD2042032G054987',
 'year': 2012}
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720414221%27 HTTP/1.1" 200 None
2026-03-29 06:10:52 [motorway.uk] INFO: Saving data for 20414221: {'auction_closing_time': 1774798200.0, 'created_time': 1774643518.443623, 'last_price_update_time': 1774764652.266949}
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20414221') HTTP/1.1" 204 0
2026-03-29 06:10:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460986.json> (referer: https://pro.motorway.co.uk) ['zyte-api']
2026-03-29 06:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with identifier: 20460986
2026-03-29 06:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with scrape type 2
2026-03-29 06:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with scrape type 2
2026-03-29 06:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: motorway.uk, Processed item id: 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a, identifier: 20460986
2026-03-29 06:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: motorway.uk, Translating item: 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with identifier: 20460986
2026-03-29 06:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: motorway.uk, Applying rules to item: 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with identifier: 20460986
2026-03-29 06:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: motorway.uk, Posting item: 69e1ecf8-c4fb-5481-bf33-1c74fd9a310a with identifier: 20460986 to the API
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 06:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 06:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://pro.motorway.co.uk/_next/data/gL_OFaxoLv6tVLfo6F2-N/vehicles/20460986.json>
{'auction_title': '',
 'category': None,
 'color': 'Blue',
 'currency': 'GBP',
 'doors_number': None,
 'engine': '2.0L',
 'engine_horse_power': None,
 'expiration_date': '2026-03-29T15:30:00Z',
 'fuel_type': 'Diesel',
 'id': '69e1ecf8-c4fb-5481-bf33-1c74fd9a310a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': None,
 'is_vat_included': False,
 'license_plate': 'YA66 FHP',
 'link_to_web_offer': 'https://pro.motorway.co.uk/vehicles/20460986',
 'listing': 'auction',
 'location': 'West Yorkshire Pontefract',
 'make': 'Land Rover',
 'model': 'Range Rover',
 'odometer': 46246,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 6846,
 'price_includes_vat': False,
 'registration_date': '2017-01-03',
 'seats_number': None,
 'seller_name': None,
 'title': 'Land Rover Range Rover Evoque SE Tech TD4',
 'transmission': 'manual',
 'trim': 'Evoque SE Tech TD4',
 'vin': 'SALVA2CN9HH195219',
 'year': 2017}
2026-03-29 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27motorway.uk%27%20and%20RowKey%20eq%20%2720460986%27 HTTP/1.1" 200 None
2026-03-29 06:10:53 [motorway.uk] INFO: Saving data for 20460986: {'auction_closing_time': 1774798200.0, 'created_time': 1774643301.578693, 'last_price_update_time': 1774764653.037724}
2026-03-29 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 06:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='motorway.uk',RowKey='20460986') HTTP/1.1" 204 0
2026-03-29 06:10:53 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 06:10:53 [motorway.uk] INFO: motorway.uk Batch config: batch 3/4
2026-03-29 06:10:53 [motorway.uk] INFO: motorway.uk Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 0}
2026-03-29 06:10:53 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (23 items) in: file:///var/lib/scrapyd/items/sourcing_v2/motorway.uk/task_4_2026-03-29T06_10_00.jl
2026-03-29 06:10:53 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 100551,
 'downloader/request_count': 45,
 'downloader/request_method_count/GET': 44,
 'downloader/request_method_count/POST': 1,
 'downloader/response_bytes': 13497976,
 'downloader/response_count': 45,
 'downloader/response_status_count/200': 45,
 'elapsed_time_seconds': 47.878291,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 6, 10, 53, 164014, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 23,
 'log_count/DEBUG': 625,
 'log_count/INFO': 1089,
 'memusage/max': 148279296,
 'memusage/startup': 148279296,
 'request_depth_max': 21,
 'response_received_count': 45,
 'scheduler/dequeued': 45,
 'scheduler/dequeued/memory': 45,
 'scheduler/enqueued': 45,
 'scheduler/enqueued/memory': 45,
 'scrape_type/batch_skipped': 515,
 'scrape_type/price_update': 23,
 'scrape_type/skipped': 145,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 45,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.3665191188040704,
 'scrapy-zyte-api/mean_response_seconds': 2.687704057867328,
 'scrapy-zyte-api/processed': 45,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 45,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 44,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 45,
 'scrapy-zyte-api/request_args/httpRequestBody': 1,
 'scrapy-zyte-api/request_args/httpRequestMethod': 1,
 'scrapy-zyte-api/request_args/httpResponseBody': 45,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 45,
 'scrapy-zyte-api/request_args/sessionContext': 43,
 'scrapy-zyte-api/request_args/url': 45,
 'scrapy-zyte-api/status_codes/200': 45,
 'scrapy-zyte-api/success': 45,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 683,
 'start_time': datetime.datetime(2026, 3, 29, 6, 10, 5, 285723, tzinfo=datetime.timezone.utc)}
2026-03-29 06:10:53 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 06:10:53 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f760c22e650>
2026-03-29 06:10:53 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f760c22ead0>