2025-12-04 19:00:05 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2025-12-04 19:00:05 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2025-12-04 19:00:05 [astonbarclay.gb] INFO: Starting spider astonbarclay.gb
2025-12-04 19:00:05 [scrapy.addons] INFO: Enabled addons:
[]
2025-12-04 19:00:05 [asyncio] DEBUG: Using selector: EpollSelector
2025-12-04 19:00:05 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2025-12-04 19:00:05 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2025-12-04 19:00:05 [scrapy.extensions.telnet] INFO: Telnet Password: a2ea396350893f1c
2025-12-04 19:00:05 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2025-12-04 19:00:05 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/astonbarclay.gb/task_36_2025-12-04T19_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2025-12-04 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 19:00:05 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2025-12-04 19:00:05 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2025-12-04 19:00:05 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2025-12-04 19:00:05 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2025-12-04 19:00:05 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2025-12-04 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:05 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2025-12-04 19:00:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2025-12-04 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:05 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2025-12-04 19:00:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2025-12-04 19:00:05 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: low_mileage_for_country.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: cars_too_new_for_country.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_price_for_currency.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_country.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: registration_date_old.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: high_mileage_for_make.json
2025-12-04 19:00:05 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2025-12-04 19:00:05 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2025-12-04 19:00:05 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2025-12-04 19:00:05 [scrapy.core.engine] INFO: Spider opened
2025-12-04 19:00:05 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2025-12-04 19:00:05 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2025-12-04 19:00:05 [scrapy-playwright] INFO: Starting download handler
2025-12-04 19:00:05 [scrapy-playwright] INFO: Starting download handler
2025-12-04 19:00:10 [scrapy-playwright] INFO: Launching browser firefox
2025-12-04 19:00:11 [scrapy-playwright] INFO: Browser firefox launched
2025-12-04 19:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2025-12-04 19:00:11 [scrapy-playwright] DEBUG: [Context=default] New page created, page count is 1 (1 for all contexts)
2025-12-04 19:00:11 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-04 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Response: <407 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-04 19:00:12 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/vehicle-search> (resource type: document)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/vehicle-search>
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.googleapis.com/css?family=Lexend> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css> (resource type: stylesheet, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js>
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css>
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/OtAutoBlock.js>
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/otSDKStub.js>
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:13 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.googleapis.com/css?family=Lexend>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://sessions.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/profileconfig> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf> (resource type: font, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/018e0e2a-b608-77ca-8640-7c5f6808ddcb.json>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/profileconfig>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/user> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/navigation> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/MuseoSans-500-BnvKCWSl.ttf>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/assets/index-f09YzuLL.js)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/user>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-vT_hcphp.js>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/assets/default-o3_sC40N.js>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/navigation>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/e-xchange-icon.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/assets/logo-BkQgdzqL.svg>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/facebook.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/facebook.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/twitter.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/twitter.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/sprite2.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/assets/index-B37Nm0Ih.css)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/sprite2.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/api/vehicle/all> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-nama.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-nama.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/WV_Awards.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/WV_Awards.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/Business_Car_Award.jpg>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/MTA_21.jpg>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/logo-bsi.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/logo-bsi.png>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2> (resource type: font, referrer: https://fonts.googleapis.com/)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://geolocation.onetrust.com/cookieconsentpub/v1/geo/location>
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:14 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/otBannerSdk.js>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://catalogue.astonbarclay.net/api/vehicle/all>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/delivered-by-aa-logo.png>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-fuel.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-manual-alt.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-engine.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-engine.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mileage.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-reg.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-reg.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-v5.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-v5.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-mot.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-mot.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-vat.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-vat.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/icon-transmission-auto.svg>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/VN23WVS/2025-12-01/image/1b287a1e-0568-4091-9506-47d673d6a741_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/VN23WVS/2025-12-01/image/1b287a1e-0568-4091-9506-47d673d6a741_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/FR19KDO/2025-12-02/image/621c1fa1-23df-4ae3-9df4-10c326fcc2ac_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/FR19KDO/2025-12-02/image/621c1fa1-23df-4ae3-9df4-10c326fcc2ac_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c3dfebb8-2b4a-4917-bfb8-3c45802e6d50_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c3dfebb8-2b4a-4917-bfb8-3c45802e6d50_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/YB73NSN/2025-11-19/image/37560904-0693-431a-8be6-3f97dba2a861_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/7130901c-5a06-4cc6-85f5-0d96339195a1_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/7130901c-5a06-4cc6-85f5-0d96339195a1_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b01e8be7-cd17-4f3b-bb0a-15aba76c016c_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b01e8be7-cd17-4f3b-bb0a-15aba76c016c_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/SK63BSO/2025-11-28/image/d4924d17-cd66-41c2-9b35-f0f34ede27ce_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/SK63BSO/2025-11-28/image/d4924d17-cd66-41c2-9b35-f0f34ede27ce_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/DP74FET/2025-11-28/image/d0428881-2191-4ee3-82ad-74a3837360f9_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/YA74HSD/2025-11-24/image/3fe55b5e-56ed-4e39-9522-e1fc86efa07e_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/YA74HSD/2025-11-24/image/3fe55b5e-56ed-4e39-9522-e1fc86efa07e_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/EJ62ABX/2025-11-19/image/c224c188-9b06-4e71-bd14-cb70a2021b75_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/EJ62ABX/2025-11-19/image/c224c188-9b06-4e71-bd14-cb70a2021b75_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/PX70XHE/2025-11-28/image/fb1f6501-e73b-44bb-9319-66f35e01e59e_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/PX70XHE/2025-11-28/image/fb1f6501-e73b-44bb-9319-66f35e01e59e_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <HEAD https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <HEAD https://abimg003.imgix.net/RO25WZJ/2025-11-11/image/d977c5dd-ba3c-446a-bd23-1086871ce7c6_removebg.jpg?w=600>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://catalogue.astonbarclay.net/img/image-unavailable.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/vehicle-search)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://catalogue.astonbarclay.net/img/image-unavailable.png>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <POST https://notify.bugsnag.com/> (resource type: xhr, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://fonts.gstatic.com/s/lexend/v26/wlptgwvFAVdoq2_F94zlCfv0bz1WCzsWzLdneg.woff2>
2025-12-04 19:00:15 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://pi.pardot.com/pd.js> (resource type: script, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/vehicle-search> (referer: None) ['playwright']
2025-12-04 19:00:16 [astonbarclay.gb] INFO: Cookies from Playwright: []
2025-12-04 19:00:16 [astonbarclay.gb] INFO: Scrapy-formatted cookies: []
2025-12-04 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='Adesa',RowKey='cookies') HTTP/1.1" 204 0
2025-12-04 19:00:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/consent/018e0e2a-b608-77ca-8640-7c5f6808ddcb/e623c1f4-7372-4084-b57d-397f3067b488/en.json>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://notify.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otFloatingRoundedCorner.json>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/v2/otPcTab.json>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCookieSettingsButton.json>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/scripttemplates/202405.1.0/assets/otCommonStyles.css>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Response: <202 https://sessions.bugsnag.com/>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/ot_close.svg>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/aec775ee-bddc-41f9-a49c-fe4f51677786/3a1d164f-420d-4fc4-9fd6-71e7e9f1a499/e435fac8-d6c5-4147-90bb-483492b13003/logo-dark-text.png>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg> (resource type: image, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Aborted Playwright request <GET https://cdn-ukwest.onetrust.com/logos/static/powered_by_logo.svg>
2025-12-04 19:00:16 [scrapy-playwright] DEBUG: [Context=default] Request: <GET https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg> (resource type: fetch, referrer: https://catalogue.astonbarclay.net/)
2025-12-04 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://cdn-ukwest.onetrust.com/logos/static/ot_guard_logo.svg>
2025-12-04 19:00:17 [scrapy-playwright] DEBUG: [Context=default] Response: <200 https://pi.pardot.com/pd.js>
2025-12-04 19:00:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/search?nonrunner=false&vehicletype=Car&agemax=9&mileagemax=320000> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117418998
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418998%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117418998: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117517675
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117517675: 2
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117190866
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190866%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117190866: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117517631
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117517631: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117099421
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117099421: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117492502
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492502%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117492502: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117399393
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399393%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117399393: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116945130
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116945130%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116945130: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117517747
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117517747: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116152685
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152685%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116152685: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117082695
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117082695%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117082695: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116152721
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116152721%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116152721: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 115997019
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115997019%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 115997019: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116931547
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116931547%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116931547: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117048263
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117048263%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117048263: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116016591
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116016591%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116016591: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117033189
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117033189%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117033189: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117457493
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457493%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117457493: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117399936
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399936%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117399936: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116496702
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116496702%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116496702: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116725518
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116725518%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116725518: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117407507
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407507%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117407507: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117100098
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117100098: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117554665
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117554665: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117554583
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117554583: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116655276
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116655276%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116655276: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117554715
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117554715: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116997220
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116997220: 2
2025-12-04 19:00:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117500036
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117500036%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117500036: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117006204
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117006204%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117006204: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117431475
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117431475%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117431475: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117505111
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505111%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117505111: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 116136757
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116136757%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 116136757: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117289497
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289497%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117289497: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117288373
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288373%27 HTTP/1.1" 200 None
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Scrape type for 117288373: 0
2025-12-04 19:00:18 [astonbarclay.gb] INFO: Found listing with ID: 117381174
2025-12-04 19:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381174%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117381174: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117383402
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117383402%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117383402: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116954790
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116954790%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116954790: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117493253
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117493253%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117493253: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117363536
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117363536%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117363536: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117433187
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433187%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117433187: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117362156
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362156%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117362156: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117220839
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117220839%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117220839: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117484817
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117484817%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117484817: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117344303
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344303%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117344303: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117274570
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274570%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117274570: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117577591
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117577591%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117577591: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117516725
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117516725%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117516725: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117473837
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117473837%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117473837: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117214042
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214042%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117214042: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117523804
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117523804%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117523804: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117058987
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117058987: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117403071
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117403071%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117403071: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117329064
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117329064: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117492465
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492465%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117492465: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116833742
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116833742: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117407917
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407917%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117407917: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116280997
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116280997: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117209040
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117209040: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117369086
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117369086: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117256307
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117256307: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117422017
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422017%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117422017: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116183620
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116183620: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116995130
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116995130%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116995130: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 116305284
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116305284%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 116305284: 0
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117446295
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Scrape type for 117446295: 2
2025-12-04 19:00:19 [astonbarclay.gb] INFO: Found listing with ID: 117121049
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121049%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117121049: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117457472
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457472%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117457472: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117418653
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418653%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117418653: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117433885
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117433885%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117433885: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117400496
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400496%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117400496: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442908
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442908%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442908: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117377340
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117377340%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117377340: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117222053
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117222053: 2
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117103708
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117103708: 2
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517675?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117099421?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517631?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517747?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117420890
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420890%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117420890: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117451511
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451511%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117451511: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117442253
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117442253%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117442253: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117420349
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420349%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117420349: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117548617
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548617%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117548617: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117579914
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579914%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117579914: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 117400056
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117400056%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 117400056: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116827121
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116827121: 2
2025-12-04 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554665?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116914684
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116914684%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116914684: 0
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Found listing with ID: 116831775
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Scrape type for 116831775: 2
2025-12-04 19:00:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117100098?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554715?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554583?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517675, 'registration': 'MA66NUC', 'account': 'ARN101', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i Sport 4dr', 'mileage': 142078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c3dfebb8-2b4a-4917-bfb8-3c45802e6d50_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c52aa856-9fea-4121-8e0b-e41791e17529_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/a8117c69-c3d5-4673-9dc3-0e4de373aacb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c922a00d-d0e9-4ef2-bc5b-38c3183e0b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/8ac160b8-c734-44a4-a785-23faacff5b70_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/e37f23af-01c5-4d20-9893-0612268c258e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/eb6b5a20-68ea-465f-a008-5e54a4a1596d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/4c25b3f8-04eb-48c0-b98e-0fb3373b3494_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/cab876e6-410b-499b-90e5-25ed7c363736_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/b5108673-d27e-4c6f-9a08-24e9ded37651_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/3148fd64-ea90-496b-be8b-5e9cdc43d203_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service digital 12/17-38k 07/18-59k 05/19-81k 09/19-94k 12/19-103k', 'remarks': 'vosa@ 88k, 105k, 113k, 121k, 128k, 135k, 141k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c265b6ef-b726-4413-ae4a-add77a5fde3a.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517675, 'registration': 'MA66NUC', 'account': 'ARN101', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '320i Sport 4dr', 'mileage': 142078, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-01', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c3dfebb8-2b4a-4917-bfb8-3c45802e6d50_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c52aa856-9fea-4121-8e0b-e41791e17529_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/a8117c69-c3d5-4673-9dc3-0e4de373aacb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/c922a00d-d0e9-4ef2-bc5b-38c3183e0b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/8ac160b8-c734-44a4-a785-23faacff5b70_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/e37f23af-01c5-4d20-9893-0612268c258e_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/eb6b5a20-68ea-465f-a008-5e54a4a1596d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/4c25b3f8-04eb-48c0-b98e-0fb3373b3494_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/cab876e6-410b-499b-90e5-25ed7c363736_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/b5108673-d27e-4c6f-9a08-24e9ded37651_removebg.jpg?w=600', 'https://abimg003.imgix.net/MA66NUC/2025-11-28/image/3148fd64-ea90-496b-be8b-5e9cdc43d203_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service digital 12/17-38k 07/18-59k 05/19-81k 09/19-94k 12/19-103k', 'remarks': 'vosa@ 88k, 105k, 113k, 121k, 128k, 135k, 141k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c265b6ef-b726-4413-ae4a-add77a5fde3a.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with identifier: 117517675
2025-12-04 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9, identifier: 117517675
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117099421, 'registration': 'BL21ZWT', 'account': 'AST003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue Titanium Edition 5dr', 'mileage': 67337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 4, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b01e8be7-cd17-4f3b-bb0a-15aba76c016c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/6a17b6d8-b7a6-4ff1-8f5f-a2db7f42399d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/0f41b845-d603-4b84-9d6c-f91df0e0041d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/35fe6568-e1a9-4158-ad7a-ff12f5266bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/32c6ee7c-52ab-4968-8e17-c779c74d474a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/36f2279b-9843-48d5-b855-4c2da27b71b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/f4bd72c8-f294-49cc-b5c5-bfa1974a847c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b4d17629-39dc-4022-be3f-e3eb389fb789_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/7c711ddd-21ac-4dfc-89c2-e23fd06d6dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b42989cd-7835-42fd-a129-8dba5d3e66a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/2476b8d4-32e0-4e99-94f5-2ff1030821ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/d81cb447-bc05-41e4-9c60-30bdb14aba49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K 59K  - V5 NUMBER ONLY', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87f76a1a-f7db-45bb-9935-560efec8a1bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117099421, 'registration': 'BL21ZWT', 'account': 'AST003', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue Titanium Edition 5dr', 'mileage': 67337, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 4, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b01e8be7-cd17-4f3b-bb0a-15aba76c016c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/6a17b6d8-b7a6-4ff1-8f5f-a2db7f42399d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/0f41b845-d603-4b84-9d6c-f91df0e0041d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/35fe6568-e1a9-4158-ad7a-ff12f5266bce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/32c6ee7c-52ab-4968-8e17-c779c74d474a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/36f2279b-9843-48d5-b855-4c2da27b71b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/f4bd72c8-f294-49cc-b5c5-bfa1974a847c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b4d17629-39dc-4022-be3f-e3eb389fb789_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/7c711ddd-21ac-4dfc-89c2-e23fd06d6dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/b42989cd-7835-42fd-a129-8dba5d3e66a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/2476b8d4-32e0-4e99-94f5-2ff1030821ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL21ZWT/2025-11-11/image/d81cb447-bc05-41e4-9c60-30bdb14aba49_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K 59K  - V5 NUMBER ONLY', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/87f76a1a-f7db-45bb-9935-560efec8a1bc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 343a5221-1fd0-593a-80b3-ee367abe339c with identifier: 117099421
2025-12-04 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 343a5221-1fd0-593a-80b3-ee367abe339c with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 343a5221-1fd0-593a-80b3-ee367abe339c with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 343a5221-1fd0-593a-80b3-ee367abe339c, identifier: 117099421
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517631, 'registration': 'SD16ZFJ', 'account': 'ARN029', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4i 16V Life 5dr', 'mileage': 52513, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/7130901c-5a06-4cc6-85f5-0d96339195a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/01ec9624-ca4e-4e1a-9af0-0f70087830ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/21d6f43f-3e3f-40a2-b2bb-62c800669534_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/959fa418-20f7-4e81-a987-ec3850a44389_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/356c980a-42b7-4898-ba83-78a935845f59_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/20cb34e8-8339-4c0e-8fe2-0b99e1fefb58_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/b35afd72-0b25-4cdb-93cc-bb89890a7515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/b3f14618-c756-4fb2-9477-cc9947bcf884_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/567c71e2-1618-4fff-b8d1-d0f79b697286_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/174460db-21a5-4a55-b7ad-ec283a3acde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/4018d73e-6096-459e-808a-ff58b9be12a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/f884ad3b-3da8-4775-a0a2-d05400b0f90e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/f90dec94-e787-45d5-8f97-d2a055ce6005_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19-22K', 'remarks': 'vosa@ 22k, 25k, 27k, 30k, 36k, 42k, 48k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a94469f-80dc-4555-b4c6-e5c6f2629777.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517631, 'registration': 'SD16ZFJ', 'account': 'ARN029', 'make': 'VAUXHALL', 'model': 'MERIVA ESTATE', 'derivative': '1.4i 16V Life 5dr', 'mileage': 52513, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/7130901c-5a06-4cc6-85f5-0d96339195a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/01ec9624-ca4e-4e1a-9af0-0f70087830ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/21d6f43f-3e3f-40a2-b2bb-62c800669534_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/959fa418-20f7-4e81-a987-ec3850a44389_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/356c980a-42b7-4898-ba83-78a935845f59_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/20cb34e8-8339-4c0e-8fe2-0b99e1fefb58_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/b35afd72-0b25-4cdb-93cc-bb89890a7515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/b3f14618-c756-4fb2-9477-cc9947bcf884_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/567c71e2-1618-4fff-b8d1-d0f79b697286_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/174460db-21a5-4a55-b7ad-ec283a3acde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/4018d73e-6096-459e-808a-ff58b9be12a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/f884ad3b-3da8-4775-a0a2-d05400b0f90e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD16ZFJ/2025-11-28/image/f90dec94-e787-45d5-8f97-d2a055ce6005_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19-22K', 'remarks': 'vosa@ 22k, 25k, 27k, 30k, 36k, 42k, 48k SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a94469f-80dc-4555-b4c6-e5c6f2629777.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62c535f1-ca9a-573d-9649-e2e85ed19d99 with identifier: 117517631
2025-12-04 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62c535f1-ca9a-573d-9649-e2e85ed19d99 with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62c535f1-ca9a-573d-9649-e2e85ed19d99 with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 62c535f1-ca9a-573d-9649-e2e85ed19d99, identifier: 117517631
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517747, 'registration': 'PX70XHE', 'account': 'ARN102', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 95 Trend 5dr', 'mileage': 93984, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 13, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX70XHE/2025-11-28/image/fb1f6501-e73b-44bb-9319-66f35e01e59e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/8a13ac2f-525a-4015-9405-06b4f5a252a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/d0da1840-ecc2-43bc-a7f6-2f7fab70faab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/6e7baae1-dc13-4c6f-bfba-477e3bbce033_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/400d8eda-fafa-4a36-99a1-12a2962abb8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/39f866fe-f471-4118-a553-662ca8ed5b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/b1b9c444-ab4e-4502-964b-f04cea8ebc80_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/4c6860e7-662f-4ab0-a5ed-e9bd8de3c71a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/eef729ca-426d-42d6-a69d-62259bfb850a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/22- 17k, 07/23- 34k, ?- 53k, ?- 70k, 02/25- 84k', 'remarks': 'vosa@ 61k, 81k EX LEARNER VEHICLE , DUAL CONTROLS STILL ON VEHICLE, spare key', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c4d81d0c-1dbb-4603-bc26-b059a65fcbde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517747, 'registration': 'PX70XHE', 'account': 'ARN102', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost 95 Trend 5dr', 'mileage': 93984, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 13, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PX70XHE/2025-11-28/image/fb1f6501-e73b-44bb-9319-66f35e01e59e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/8a13ac2f-525a-4015-9405-06b4f5a252a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/d0da1840-ecc2-43bc-a7f6-2f7fab70faab_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/6e7baae1-dc13-4c6f-bfba-477e3bbce033_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/400d8eda-fafa-4a36-99a1-12a2962abb8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/39f866fe-f471-4118-a553-662ca8ed5b4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/b1b9c444-ab4e-4502-964b-f04cea8ebc80_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/4c6860e7-662f-4ab0-a5ed-e9bd8de3c71a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PX70XHE/2025-11-28/image/eef729ca-426d-42d6-a69d-62259bfb850a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/22- 17k, 07/23- 34k, ?- 53k, ?- 70k, 02/25- 84k', 'remarks': 'vosa@ 61k, 81k EX LEARNER VEHICLE , DUAL CONTROLS STILL ON VEHICLE, spare key', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c4d81d0c-1dbb-4603-bc26-b059a65fcbde.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with identifier: 117517747
2025-12-04 19:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with scrape type 2
2025-12-04 19:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with scrape type 2
2025-12-04 19:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b723fa8b-a69b-583b-9ba4-27656b2cfdd3, identifier: 117517747
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116699888
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699888%27 HTTP/1.1" 200 None
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116699888: 0
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116699739
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116699739%27 HTTP/1.1" 200 None
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116699739: 0
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 116318543
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116318543%27 HTTP/1.1" 200 None
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Scrape type for 116318543: 0
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Found listing with ID: 117339782
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Scrape type for 117339782: 2
2025-12-04 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with identifier: 117517675
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE HTTP/1.1" 200 None
2025-12-04 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2025-12-04 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with identifier: 117517675
2025-12-04 19:00:21 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5c6aa06e-ab1b-5d77-b4a0-b829ecb175b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MA66NUC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517675',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 142078,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'Arnold Clark',
 'title': 'BMW 3 SERIES SALOON 320i Sport 4dr',
 'transmission': 'manual',
 'trim': '320i Sport 4dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517675%27 HTTP/1.1" 200 None
2025-12-04 19:00:21 [astonbarclay.gb] INFO: Saving data for 117517675: {'auction_closing_time': 1764842400.0, 'created_time': 1764184258.898574, 'last_price_update_time': 1764874821.482445}
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517675') HTTP/1.1" 204 0
2025-12-04 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 343a5221-1fd0-593a-80b3-ee367abe339c with identifier: 117099421
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLUE HTTP/1.1" 200 None
2025-12-04 19:00:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2025-12-04 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 343a5221-1fd0-593a-80b3-ee367abe339c with identifier: 117099421
2025-12-04 19:00:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 343a5221-1fd0-593a-80b3-ee367abe339c with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '343a5221-1fd0-593a-80b3-ee367abe339c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BL21ZWT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117099421',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 67337,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-19',
 'seller_name': 'TCB Group - Value',
 'title': 'FORD KUGA DIESEL ESTATE 1.5 EcoBlue Titanium Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue Titanium Edition 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099421%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Saving data for 117099421: {'auction_closing_time': 1764842400.0, 'created_time': 1762851707.840538, 'last_price_update_time': 1764874822.094922}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117099421') HTTP/1.1" 204 0
2025-12-04 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 62c535f1-ca9a-573d-9649-e2e85ed19d99 with identifier: 117517631
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=RED HTTP/1.1" 200 None
2025-12-04 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 62c535f1-ca9a-573d-9649-e2e85ed19d99 with identifier: 117517631
2025-12-04 19:00:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 62c535f1-ca9a-573d-9649-e2e85ed19d99 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '62c535f1-ca9a-573d-9649-e2e85ed19d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SD16ZFJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517631',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'MERIVA ESTATE',
 'odometer': 52513,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Arnold Clark',
 'title': 'VAUXHALL MERIVA ESTATE 1.4i 16V Life 5dr',
 'transmission': 'manual',
 'trim': '1.4i 16V Life 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517631%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Saving data for 117517631: {'auction_closing_time': 1764842400.0, 'created_time': 1764184292.851321, 'last_price_update_time': 1764874822.304917}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517631') HTTP/1.1" 204 0
2025-12-04 19:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with identifier: 117517747
2025-12-04 19:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with identifier: 117517747
2025-12-04 19:00:22 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b723fa8b-a69b-583b-9ba4-27656b2cfdd3 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b723fa8b-a69b-583b-9ba4-27656b2cfdd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PX70XHE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517747',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 93984,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-31',
 'seller_name': 'Arnold Clark',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost 95 Trend 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 95 Trend 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517747%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Saving data for 117517747: {'auction_closing_time': 1764842400.0, 'created_time': 1764184289.940974, 'last_price_update_time': 1764874822.491341}
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517747') HTTP/1.1" 204 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117547841
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547841%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117547841: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117629259
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117629259%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117629259: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117617912
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117617912%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117617912: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117664657
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664657%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117664657: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117630789
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117630789%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117630789: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 116983938
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116983938%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 116983938: 0
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117183441
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117183441: 2
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Found listing with ID: 117555034
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Scrape type for 117555034: 2
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554665, 'registration': 'YM69KTU', 'account': 'MAZ084', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.4 Boosterjet Sport 5dr', 'mileage': 72901, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 43, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-16', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM69KTU/2025-12-02/image/196673b1-8241-42de-bd22-a23b4480aa36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/c581815a-6014-42af-adc4-fe98213912bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/2e37b878-c40d-467d-a4d4-8067b111de6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/51327c9b-0fcb-4db9-b6c1-c12f20bb250d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/79c25e2f-3f7c-43fe-a8f9-97acabb7ecab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/468584bc-8368-4999-9c5d-eaa4aa141131_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/abf15118-0980-4ef4-97de-b092905a5955_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/b79dc523-a560-4541-83b2-2739d1e807ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/fee72206-f26b-4e70-8604-8e85a0b73e5f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-2K, 08/23-34K', 'remarks': 'vosa@ 24k, 41k, 41k, 56k, SPARE KEY + SD CARD IN OFFICE / BUYER TO APPLY FOR V62', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e4315185-1ea3-4c74-92ae-c8f0a016cd3c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554665, 'registration': 'YM69KTU', 'account': 'MAZ084', 'make': 'SUZUKI', 'model': 'SWIFT HATCHBACK', 'derivative': '1.4 Boosterjet Sport 5dr', 'mileage': 72901, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 43, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-16', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YM69KTU/2025-12-02/image/196673b1-8241-42de-bd22-a23b4480aa36_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/c581815a-6014-42af-adc4-fe98213912bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/2e37b878-c40d-467d-a4d4-8067b111de6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/51327c9b-0fcb-4db9-b6c1-c12f20bb250d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/79c25e2f-3f7c-43fe-a8f9-97acabb7ecab_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/468584bc-8368-4999-9c5d-eaa4aa141131_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/abf15118-0980-4ef4-97de-b092905a5955_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/b79dc523-a560-4541-83b2-2739d1e807ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/YM69KTU/2025-12-02/image/fee72206-f26b-4e70-8604-8e85a0b73e5f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20-2K, 08/23-34K', 'remarks': 'vosa@ 24k, 41k, 41k, 56k, SPARE KEY + SD CARD IN OFFICE / BUYER TO APPLY FOR V62', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e4315185-1ea3-4c74-92ae-c8f0a016cd3c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aceb5d02-0b00-53b0-b6d2-d8391226c5be with identifier: 117554665
2025-12-04 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aceb5d02-0b00-53b0-b6d2-d8391226c5be with scrape type 2
2025-12-04 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aceb5d02-0b00-53b0-b6d2-d8391226c5be with scrape type 2
2025-12-04 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: aceb5d02-0b00-53b0-b6d2-d8391226c5be, identifier: 117554665
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117100098, 'registration': 'LL70ZNW', 'account': 'ARN218', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 155 S Edition 5dr EDC', 'mileage': 15073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 42, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-01-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/d6a4493b-4cab-45af-b3e7-703158b20456_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/e551a330-a6d3-42d0-9010-13a8061baa0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/dde6f4c9-71f5-4841-9900-2eeaca7bc3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/f173b789-3b14-410f-ab34-a9d816ddb870_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/5d597209-e89f-47b8-a4a6-141e4315459c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/6651a0f7-9b97-43b7-9806-b37925ab1444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/012e5fa9-aa8e-466d-81ba-c77475e4f595_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/c390cf07-8126-4f65-a01b-a09c85901d37_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25- 12k', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair CAT N - NON-STRUCTURAL - Damage is normal wear and minor dents/scratches CAT N - NON-STRUCTURAL - Damage is water/flood and mechanical vosa@ 8k, 10k, 13k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6035811e-3c76-49e5-9eae-3663822e007b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117100098, 'registration': 'LL70ZNW', 'account': 'ARN218', 'make': 'RENAULT', 'model': 'CAPTUR HATCHBACK', 'derivative': '1.3 TCE 155 S Edition 5dr EDC', 'mileage': 15073, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 42, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-01-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-26', 'doors': 5, 'engineSize': 1333, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/d6a4493b-4cab-45af-b3e7-703158b20456_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/e551a330-a6d3-42d0-9010-13a8061baa0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/dde6f4c9-71f5-4841-9900-2eeaca7bc3c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/f173b789-3b14-410f-ab34-a9d816ddb870_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/5d597209-e89f-47b8-a4a6-141e4315459c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/6651a0f7-9b97-43b7-9806-b37925ab1444_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/012e5fa9-aa8e-466d-81ba-c77475e4f595_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL70ZNW/2025-11-12/image/c390cf07-8126-4f65-a01b-a09c85901d37_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/25- 12k', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair CAT N - NON-STRUCTURAL - Damage is normal wear and minor dents/scratches CAT N - NON-STRUCTURAL - Damage is water/flood and mechanical vosa@ 8k, 10k, 13k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6035811e-3c76-49e5-9eae-3663822e007b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-12-04 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9a503e9-3915-5374-8d02-c01114cb6b48 with scrape type 2
2025-12-04 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9a503e9-3915-5374-8d02-c01114cb6b48 with scrape type 2
2025-12-04 19:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a9a503e9-3915-5374-8d02-c01114cb6b48, identifier: 117100098
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554715, 'registration': 'VU68TYP', 'account': 'ARN167', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi Premium 5dr 2WD', 'mileage': 147843, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 47, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU68TYP/2025-12-02/image/f746206d-fc05-4a0b-9491-19fe8f3a2feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/cd561a62-45ca-4fb8-992a-0e80db25f5e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/f6f4ca41-4350-40f5-b13f-7988ec8a098a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/0aad6d6a-95ef-4914-89e3-02b8687b9a03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/7e678bf9-551e-4ad1-8a2c-d1d82d6c2ee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/6f0a6a32-57ad-4551-a0c2-8ed826799928_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/6f392ece-2bf8-4c5c-bb54-c6b0069a6c8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/76662242-82f2-4f2f-a798-aa8355d0f744_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 10/22-79k', 'remarks': 'vosa@ 56k, 79k, 93k, 116k, 147k spare key & sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fdbda7a6-c232-4888-8edc-a1ed2ce4ec33.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554715, 'registration': 'VU68TYP', 'account': 'ARN167', 'make': 'HYUNDAI', 'model': 'TUCSON DIESEL ESTATE', 'derivative': '1.6 CRDi Premium 5dr 2WD', 'mileage': 147843, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 47, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Diesel', 'motExpiry': '2026-10-28', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VU68TYP/2025-12-02/image/f746206d-fc05-4a0b-9491-19fe8f3a2feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/cd561a62-45ca-4fb8-992a-0e80db25f5e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/f6f4ca41-4350-40f5-b13f-7988ec8a098a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/0aad6d6a-95ef-4914-89e3-02b8687b9a03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/7e678bf9-551e-4ad1-8a2c-d1d82d6c2ee6_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/6f0a6a32-57ad-4551-a0c2-8ed826799928_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/6f392ece-2bf8-4c5c-bb54-c6b0069a6c8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VU68TYP/2025-12-02/image/76662242-82f2-4f2f-a798-aa8355d0f744_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 10/22-79k', 'remarks': 'vosa@ 56k, 79k, 93k, 116k, 147k spare key & sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fdbda7a6-c232-4888-8edc-a1ed2ce4ec33.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with identifier: 117554715
2025-12-04 19:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with scrape type 2
2025-12-04 19:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with scrape type 2
2025-12-04 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9af07fa2-cf74-5f94-a72b-8b479b5e0df1, identifier: 117554715
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554583, 'registration': 'ST18ZVR', 'account': 'ARN144', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 3dr', 'mileage': 104244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 44, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-16', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/535201fe-5ac3-4cf8-98e5-74151850d937_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/76f42e5d-20ee-4f25-83be-d8897f3c335d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/4aa48500-fa4b-4de0-898a-fffb27aaa989_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/5a9a7822-b76b-4cec-85c6-1f47e24cd4b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/2220e8cf-eb50-409e-94e1-5c51ac103286_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/937ef5d2-cc4e-4b83-aad7-bca03f5cd8d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/21c1858d-d3df-4a8d-9577-e26100a2a614_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/5ee01377-dc84-4e8b-91e2-5531a16708d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 16k, 21k, 34k, 55k, 82k, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a4572e2-12c8-480a-bbe8-739f226ec252.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554583, 'registration': 'ST18ZVR', 'account': 'ARN144', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 3dr', 'mileage': 104244, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 44, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-16', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/535201fe-5ac3-4cf8-98e5-74151850d937_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/76f42e5d-20ee-4f25-83be-d8897f3c335d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/4aa48500-fa4b-4de0-898a-fffb27aaa989_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/5a9a7822-b76b-4cec-85c6-1f47e24cd4b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/2220e8cf-eb50-409e-94e1-5c51ac103286_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/937ef5d2-cc4e-4b83-aad7-bca03f5cd8d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/21c1858d-d3df-4a8d-9577-e26100a2a614_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST18ZVR/2025-12-02/image/5ee01377-dc84-4e8b-91e2-5531a16708d8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa@ 16k, 21k, 34k, 55k, 82k, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4a4572e2-12c8-480a-bbe8-739f226ec252.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8a45e66-886b-596c-9170-c038b1e58321 with identifier: 117554583
2025-12-04 19:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8a45e66-886b-596c-9170-c038b1e58321 with scrape type 2
2025-12-04 19:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8a45e66-886b-596c-9170-c038b1e58321 with scrape type 2
2025-12-04 19:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e8a45e66-886b-596c-9170-c038b1e58321, identifier: 117554583
2025-12-04 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: aceb5d02-0b00-53b0-b6d2-d8391226c5be with identifier: 117554665
2025-12-04 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: aceb5d02-0b00-53b0-b6d2-d8391226c5be with identifier: 117554665
2025-12-04 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: aceb5d02-0b00-53b0-b6d2-d8391226c5be with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'aceb5d02-0b00-53b0-b6d2-d8391226c5be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YM69KTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554665',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SUZUKI',
 'model': 'SWIFT HATCHBACK',
 'odometer': 72901,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-16',
 'seller_name': 'Arnold Clark',
 'title': 'SUZUKI SWIFT HATCHBACK 1.4 Boosterjet Sport 5dr',
 'transmission': 'manual',
 'trim': '1.4 Boosterjet Sport 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554665%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Saving data for 117554665: {'auction_closing_time': 1764842400.0, 'created_time': 1764270293.551474, 'last_price_update_time': 1764874823.189309}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554665') HTTP/1.1" 204 0
2025-12-04 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BLACK HTTP/1.1" 200 None
2025-12-04 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a9a503e9-3915-5374-8d02-c01114cb6b48 with identifier: 117100098
2025-12-04 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: a9a503e9-3915-5374-8d02-c01114cb6b48 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a9a503e9-3915-5374-8d02-c01114cb6b48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL70ZNW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117100098',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'CAPTUR HATCHBACK',
 'odometer': 15073,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-01-06',
 'seller_name': 'Arnold Clark',
 'title': 'RENAULT CAPTUR HATCHBACK 1.3 TCE 155 S Edition 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE 155 S Edition 5dr EDC',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100098%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Saving data for 117100098: {'auction_closing_time': 1764842400.0, 'created_time': 1762887720.416408, 'last_price_update_time': 1764874823.370356}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117100098') HTTP/1.1" 204 0
2025-12-04 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with identifier: 117554715
2025-12-04 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with identifier: 117554715
2025-12-04 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 9af07fa2-cf74-5f94-a72b-8b479b5e0df1 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9af07fa2-cf74-5f94-a72b-8b479b5e0df1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VU68TYP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554715',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'HYUNDAI',
 'model': 'TUCSON DIESEL ESTATE',
 'odometer': 147843,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': 'Arnold Clark',
 'title': 'HYUNDAI TUCSON DIESEL ESTATE 1.6 CRDi Premium 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.6 CRDi Premium 5dr 2WD',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554715%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Saving data for 117554715: {'auction_closing_time': 1764842400.0, 'created_time': 1764270234.856991, 'last_price_update_time': 1764874823.4016}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554715') HTTP/1.1" 204 0
2025-12-04 19:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e8a45e66-886b-596c-9170-c038b1e58321 with identifier: 117554583
2025-12-04 19:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e8a45e66-886b-596c-9170-c038b1e58321 with identifier: 117554583
2025-12-04 19:00:23 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: e8a45e66-886b-596c-9170-c038b1e58321 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'e8a45e66-886b-596c-9170-c038b1e58321',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ST18ZVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554583',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 104244,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Arnold Clark',
 'title': 'MINI HATCHBACK 1.5 Cooper II 3dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 3dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554583%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Saving data for 117554583: {'auction_closing_time': 1764842400.0, 'created_time': 1764270228.098885, 'last_price_update_time': 1764874823.453702}
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554583') HTTP/1.1" 204 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117374089
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117374089: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117555641
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117555641: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117448541
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117448541: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117547879
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547879%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117547879: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117508313
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508313%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117508313: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117457056
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117457056%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117457056: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117447701
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447701%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117447701: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117597727
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597727%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117597727: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117274456
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274456%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117274456: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117410407
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117410407%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117410407: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 115510423
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115510423%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 115510423: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117240084
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117240084: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116997115
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997115%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116997115: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117509758
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117509758%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117509758: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117565754
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117565754%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117565754: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 116859206
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859206%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 116859206: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117549752
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549752%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117549752: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117544110
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544110%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117544110: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117575865
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117575865%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117575865: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117427071
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117427071: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117590494
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590494%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117590494: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117103769
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103769%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117103769: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117491214
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491214%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117491214: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117508301
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508301%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117508301: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117103670
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103670%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117103670: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117274004
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117274004: 2
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117100813
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117100813%27 HTTP/1.1" 200 None
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Scrape type for 117100813: 0
2025-12-04 19:00:23 [astonbarclay.gb] INFO: Found listing with ID: 117508326
2025-12-04 19:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117508326%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117508326: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117446881
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446881%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117446881: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117215446
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215446%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117215446: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117180618
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180618%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117180618: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117549690
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549690%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117549690: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117524612
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117524612%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117524612: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117133968
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117133968%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117133968: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117188811
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117188811: 2
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117561425
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117561425%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117561425: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116637669
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116637669%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116637669: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117311401
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311401%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117311401: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117056567
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117056567%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117056567: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117417496
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117417496%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117417496: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117120537
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117120537: 2
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117029988
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117029988%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117029988: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117019833
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117019833: 2
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117256307?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117369086?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116833742?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117329064?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117344624
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117344624%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117344624: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117549728
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117549728%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117549728: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117367108
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117367108%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117367108: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117372665
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372665%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117372665: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117180212
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117180212: 2
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117446714
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446714%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117446714: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117581526
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581526%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117581526: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 116833978
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833978%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 116833978: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117215585
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117215585: 2
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116280997?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116997220?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117430085
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117430085%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117430085: 1
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117058987?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117256307, 'registration': 'OV71KXJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 Loft Nav 62kWh 5dr Auto', 'mileage': 96532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 214, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 10/25-95k,', 'remarks': 'SPARE KEY, *Metallic - Race blue, Drive sport pack - Enyaq / Loft design pack - grey fabric / artificial leather*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db4c4783-84e2-4df0-b41f-dcc8808d4af0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117256307, 'registration': 'OV71KXJ', 'account': 'KIN032', 'make': 'SKODA', 'model': 'ENYAQ IV ESTATE', 'derivative': '132kW 60 Loft Nav 62kWh 5dr Auto', 'mileage': 96532, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 214, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Electric', 'motExpiry': '2026-11-01', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/04fa30d7-e082-410c-b242-d3da48933c08_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/b1a39a40-87c6-4c7b-b701-bd9ddf7a301a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/3c7412ca-2e59-49b4-ada9-8ef59ad6c0a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/5a975e58-8f33-486f-bd4f-8b0bbd71c52c_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/edb3baa6-6f4f-488c-975a-c598ea0187a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/d56130e3-3c67-4479-b68f-acc148b2f4d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/851503ce-859b-4dfb-a67f-554f1db19a36_removebg.jpg?w=600', 'https://abimg003.imgix.net/OV71KXJ/2025-11-19/image/856a0ded-5f6c-4959-9e75-bf2e929e875d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 10/25-95k,', 'remarks': 'SPARE KEY, *Metallic - Race blue, Drive sport pack - Enyaq / Loft design pack - grey fabric / artificial leather*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/db4c4783-84e2-4df0-b41f-dcc8808d4af0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-12-04 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 696f7c52-0072-5b70-95f2-a5ab6ddda589 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 696f7c52-0072-5b70-95f2-a5ab6ddda589 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 696f7c52-0072-5b70-95f2-a5ab6ddda589, identifier: 117256307
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117369086, 'registration': 'GY72DFC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 17931, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 213, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23-6k, 09/24-12k, 09/25-16k,', 'remarks': 'SPARE KEY, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5707cf4c-e330-4008-8b47-5d00fd0949a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117369086, 'registration': 'GY72DFC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 17931, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 213, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-09', 'fuel': 'Electric', 'motExpiry': '2026-11-08', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GY72DFC/2025-11-20/image/be705a06-ed35-4a55-a3b8-9c76d7b0b3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/1e2983ce-c2c9-4701-a317-9b18ca8d9513_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/d452c9f0-6da8-4281-ba08-afa080d851f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/c7b148a0-ea24-4a39-a7d1-459a4a747bfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/08ba80ce-a1a3-4ed7-b712-585e0a8e5e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2babe383-bb53-4ce2-b70e-72670eda4e26_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/70fc524e-c0a6-4bdc-8b75-311414bed7d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY72DFC/2025-11-20/image/2a2fbdb3-ffa5-4d30-9474-089470f1c4b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/23-6k, 09/24-12k, 09/25-16k,', 'remarks': 'SPARE KEY, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5707cf4c-e330-4008-8b47-5d00fd0949a1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-12-04 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5104a921-562c-5392-ba72-2df013980db0 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5104a921-562c-5392-ba72-2df013980db0 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5104a921-562c-5392-ba72-2df013980db0, identifier: 117369086
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116833742, 'registration': 'BJ72XGU', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 30047, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 205, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-01', 'fuel': 'Electric', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-20k,', 'remarks': 'SPARE KEY, VOSA STATES 29K, *Solid - Vapor grey, SEAQUAL Yarn cloth - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8907362-8d3e-4454-951f-e3fb548100a4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116833742, 'registration': 'BJ72XGU', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 30047, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 205, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-01', 'fuel': 'Electric', 'motExpiry': '2026-09-24', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/09b83611-af05-4d01-aedb-d6b2275e6622_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/ea413806-589c-4823-b360-97b861c76aed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a012369a-b8e6-4919-8265-2a9a0b31ccf4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/279b1715-7aad-48c5-bea4-5cacea1f7e86_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/4cc5c5ab-ef6a-4b77-a5f5-c4aee23b436d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/a5494d4e-fa5b-4c73-bad7-fc5f97de75b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/7e5df61a-dc31-4394-af9f-5a704a977fa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72XGU/2025-10-31/image/edbdc995-3863-4875-b3a0-63ea38622c5a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 10/24-20k,', 'remarks': 'SPARE KEY, VOSA STATES 29K, *Solid - Vapor grey, SEAQUAL Yarn cloth - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8907362-8d3e-4454-951f-e3fb548100a4.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-12-04 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 768dc5ad-bed0-59b4-9296-cfd1b5a15366, identifier: 116833742
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117329064, 'registration': 'DV22UNN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 9836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 202, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-31', 'fuel': 'Electric', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22UNN/2025-11-28/image/5366dadc-84ce-43eb-a264-126c57569f23_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/cf11b070-e5aa-4ab5-9029-271bdd8f3a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/3bbc2aaf-48c7-4e5b-bc8a-8cc4bf9e72a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/e32b2079-3262-4b54-bd24-c828985dbd3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/db08b012-8611-44ee-8e12-f8722940b6f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/0630a512-9f03-4c54-ae00-618466827606_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/022cf8f0-e76a-41e2-9636-a583cb782a5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/7b06bf35-c1c9-4e79-a138-d90c9aa7356b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25-7k,', 'remarks': 'SPARE KEY, *Solid - Arctic white, Leather - Black with contrast stitching*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bb5b17b-66af-4adb-98be-d73c68720453.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117329064, 'registration': 'DV22UNN', 'account': 'KIN032', 'make': 'MG MOTOR UK', 'model': 'ZS ELECTRIC HATCHBACK', 'derivative': '130kW Trophy EV 51kWh 5dr Auto', 'mileage': 9836, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 202, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-03-31', 'fuel': 'Electric', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DV22UNN/2025-11-28/image/5366dadc-84ce-43eb-a264-126c57569f23_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/cf11b070-e5aa-4ab5-9029-271bdd8f3a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/3bbc2aaf-48c7-4e5b-bc8a-8cc4bf9e72a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/e32b2079-3262-4b54-bd24-c828985dbd3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/db08b012-8611-44ee-8e12-f8722940b6f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/0630a512-9f03-4c54-ae00-618466827606_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/022cf8f0-e76a-41e2-9636-a583cb782a5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DV22UNN/2025-11-28/image/7b06bf35-c1c9-4e79-a138-d90c9aa7356b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 04/25-7k,', 'remarks': 'SPARE KEY, *Solid - Arctic white, Leather - Black with contrast stitching*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bb5b17b-66af-4adb-98be-d73c68720453.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-12-04 19:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with scrape type 2
2025-12-04 19:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d959fa5-65a5-5ff1-adc4-571dd55e1550, identifier: 117329064
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117415492
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415492%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117415492: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117441346
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441346%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117441346: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117441244
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441244%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117441244: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117441120
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441120%27 HTTP/1.1" 200 None
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Scrape type for 117441120: 0
2025-12-04 19:00:24 [astonbarclay.gb] INFO: Found listing with ID: 117441140
2025-12-04 19:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441140%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441140: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441149
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441149%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441149: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117441190
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117441190%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117441190: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117572022
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572022%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117572022: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117394554
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394554%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117394554: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117179358
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117179358%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117179358: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117539707
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117539707: 2
2025-12-04 19:00:25 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with identifier: 117256307
2025-12-04 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 696f7c52-0072-5b70-95f2-a5ab6ddda589 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '696f7c52-0072-5b70-95f2-a5ab6ddda589',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'OV71KXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117256307',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'ENYAQ IV ESTATE',
 'odometer': 96532,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': 'Kinto',
 'title': 'SKODA ENYAQ IV ESTATE 132kW 60 Loft Nav 62kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '132kW 60 Loft Nav 62kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117256307%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Saving data for 117256307: {'auction_closing_time': 1764842400.0, 'created_time': 1764270311.680509, 'last_price_update_time': 1764874825.237386}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117256307') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=SILVER HTTP/1.1" 200 None
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5104a921-562c-5392-ba72-2df013980db0 with identifier: 117369086
2025-12-04 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 5104a921-562c-5392-ba72-2df013980db0 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '5104a921-562c-5392-ba72-2df013980db0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GY72DFC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117369086',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 17931,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-09',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117369086%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Saving data for 117369086: {'auction_closing_time': 1764842400.0, 'created_time': 1764270330.643482, 'last_price_update_time': 1764874825.583273}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117369086') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GREY HTTP/1.1" 200 None
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with identifier: 116833742
2025-12-04 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 768dc5ad-bed0-59b4-9296-cfd1b5a15366 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '768dc5ad-bed0-59b4-9296-cfd1b5a15366',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BJ72XGU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116833742',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 30047,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-01',
 'seller_name': 'Kinto',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V2 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V2 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116833742%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Saving data for 116833742: {'auction_closing_time': 1764842400.0, 'created_time': 1764270267.810607, 'last_price_update_time': 1764874825.767244}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116833742') HTTP/1.1" 204 0
2025-12-04 19:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-12-04 19:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with identifier: 117329064
2025-12-04 19:00:25 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 8d959fa5-65a5-5ff1-adc4-571dd55e1550 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '8d959fa5-65a5-5ff1-adc4-571dd55e1550',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DV22UNN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117329064',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MG MOTOR UK',
 'model': 'ZS ELECTRIC HATCHBACK',
 'odometer': 9836,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-31',
 'seller_name': 'Kinto',
 'title': 'MG MOTOR UK ZS ELECTRIC HATCHBACK 130kW Trophy EV 51kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '130kW Trophy EV 51kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117329064%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Saving data for 117329064: {'auction_closing_time': 1764842400.0, 'created_time': 1764270301.046389, 'last_price_update_time': 1764874825.808576}
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117329064') HTTP/1.1" 204 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117253439
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253439%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117253439: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 116489973
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116489973%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 116489973: 0
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 117742183
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117742183%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 117742183: 1
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Found listing with ID: 115951190
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951190%27 HTTP/1.1" 200 None
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Scrape type for 115951190: 2
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116280997, 'registration': 'GU72VHK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 27494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 209, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-08', 'fuel': 'Electric', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHK/2025-10-31/image/f6626e5f-c699-4ddd-b2b9-e63fc0f140dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/8f6a41c7-9d18-46d3-9e04-a43669f27a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/06355831-9969-47c1-897e-e3cda2ab58d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e261c408-f652-4d19-9028-0e4618d349e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/1445fbad-4a69-4e2f-a758-24bb1972af68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e5036134-abb4-460c-9609-3fce108f0de8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/5b542d13-ff38-4999-ae7f-ac6246b48699_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/6ad931e5-d88d-4a0d-bd30-66ef1edc1783_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-8K, 11/24-18K,', 'remarks': 'SPARE KEY, vosa states 25k, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c73a7d3-ec64-4824-ba22-8df802d3773b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:25 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116280997, 'registration': 'GU72VHK', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 27494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 209, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-08', 'fuel': 'Electric', 'motExpiry': '2026-09-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHK/2025-10-31/image/f6626e5f-c699-4ddd-b2b9-e63fc0f140dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/8f6a41c7-9d18-46d3-9e04-a43669f27a61_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/06355831-9969-47c1-897e-e3cda2ab58d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e261c408-f652-4d19-9028-0e4618d349e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/1445fbad-4a69-4e2f-a758-24bb1972af68_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/e5036134-abb4-460c-9609-3fce108f0de8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/5b542d13-ff38-4999-ae7f-ac6246b48699_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHK/2025-10-31/image/6ad931e5-d88d-4a0d-bd30-66ef1edc1783_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-8K, 11/24-18K,', 'remarks': 'SPARE KEY, vosa states 25k, *Metallic - Mojave silver, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c73a7d3-ec64-4824-ba22-8df802d3773b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-12-04 19:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b81bcc2e-4ebc-58e0-ad41-cc52388682db with scrape type 2
2025-12-04 19:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b81bcc2e-4ebc-58e0-ad41-cc52388682db with scrape type 2
2025-12-04 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b81bcc2e-4ebc-58e0-ad41-cc52388682db, identifier: 116280997
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116997220, 'registration': 'SJ69KPZ', 'account': 'ARN239', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi ISG 2 5dr [AWD]', 'mileage': 114114, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 51, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/09cb9d32-e926-4871-88ed-391e2eabb0dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/9296bbf8-af88-4b11-a018-cfbbf1370343_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/9cddc7b8-a69a-4b35-af13-dbab7a4618dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/b54ddb9d-9f06-4059-8b68-3d061d243be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/66fc3de3-4e0e-4d0a-bf6c-7a2b5cc45491_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/ba9a4c6c-c3c7-46bf-9d8e-c56e27eef1c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/74d893e4-b8bb-47a6-8f50-d1cdbc9b8c3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/6d1862a5-7704-4909-80ce-798d9fd25bc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/31180225-6a49-45b8-b0f6-96dd141a4847_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/85512c0a-f926-4f11-919e-2546467a7175_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/cb534a82-6f5b-48a9-8c82-9b7bb306f102_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/e743c89a-6754-4e71-9b33-8cf8aee433b8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa@ 64k, 84k, 102k spare key & sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 178, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63f18f17-2043-4af3-aa58-e5bdc0600ce4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116997220, 'registration': 'SJ69KPZ', 'account': 'ARN239', 'make': 'KIA', 'model': 'SPORTAGE ESTATE', 'derivative': '1.6T GDi ISG 2 5dr [AWD]', 'mileage': 114114, 'mileageWarranty': True, 'type': 'car', 'saleId': 17791, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-04T10:00Z', 'lot': 51, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-30', 'doors': 5, 'engineSize': 1591, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/09cb9d32-e926-4871-88ed-391e2eabb0dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/9296bbf8-af88-4b11-a018-cfbbf1370343_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/9cddc7b8-a69a-4b35-af13-dbab7a4618dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/b54ddb9d-9f06-4059-8b68-3d061d243be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/66fc3de3-4e0e-4d0a-bf6c-7a2b5cc45491_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/ba9a4c6c-c3c7-46bf-9d8e-c56e27eef1c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/74d893e4-b8bb-47a6-8f50-d1cdbc9b8c3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/6d1862a5-7704-4909-80ce-798d9fd25bc6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/31180225-6a49-45b8-b0f6-96dd141a4847_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/85512c0a-f926-4f11-919e-2546467a7175_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/cb534a82-6f5b-48a9-8c82-9b7bb306f102_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ69KPZ/2025-11-14/image/e743c89a-6754-4e71-9b33-8cf8aee433b8_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'vosa@ 64k, 84k, 102k spare key & sd card in office', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 178, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/63f18f17-2043-4af3-aa58-e5bdc0600ce4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with identifier: 116997220
2025-12-04 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with scrape type 2
2025-12-04 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with scrape type 2
2025-12-04 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2f662f1f-f63a-550a-b8f8-0087c4ca4db1, identifier: 116997220
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117058987, 'registration': 'GU72VHR', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 35708, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 201, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-14k, 10/24-29k, 10/25-35k,', 'remarks': 'SPARE KEY, Metallic - Mojave silver, Leather - Black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96180d8f-1d78-41b5-bc06-1db9a99a7ee2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117058987, 'registration': 'GU72VHR', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 35708, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 201, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-08', 'fuel': 'Electric', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VHR/2025-11-11/image/5ca3e688-3e76-4a96-b507-f1446405a70b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/7aeb8551-1b67-4365-b946-3f6e9409413f_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/432e824c-3610-4090-acf7-3b3841d66388_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4542228f-d669-4240-afdc-68f72e9f1041_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/441c359c-b89d-468a-b444-432c4329164d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/f8d7649f-5065-4a3c-a3d2-ee5b91ebcd9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/4eb93e8d-ce40-4f1e-b386-1c45dcbb5469_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VHR/2025-11-11/image/c43b9389-75d6-4da5-9a72-f86c848b560a_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 11/23-14k, 10/24-29k, 10/25-35k,', 'remarks': 'SPARE KEY, Metallic - Mojave silver, Leather - Black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/96180d8f-1d78-41b5-bc06-1db9a99a7ee2.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-12-04 19:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ac040797-1bbe-5a68-a3ef-1b65270586ce with scrape type 2
2025-12-04 19:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ac040797-1bbe-5a68-a3ef-1b65270586ce with scrape type 2
2025-12-04 19:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ac040797-1bbe-5a68-a3ef-1b65270586ce, identifier: 117058987
2025-12-04 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-12-04 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b81bcc2e-4ebc-58e0-ad41-cc52388682db with identifier: 116280997
2025-12-04 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b81bcc2e-4ebc-58e0-ad41-cc52388682db with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'b81bcc2e-4ebc-58e0-ad41-cc52388682db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72VHK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116280997',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 27494,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-08',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116280997%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Saving data for 116280997: {'auction_closing_time': 1764842400.0, 'created_time': 1763147056.359104, 'last_price_update_time': 1764874826.219388}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116280997') HTTP/1.1" 204 0
2025-12-04 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with identifier: 116997220
2025-12-04 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with identifier: 116997220
2025-12-04 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 2f662f1f-f63a-550a-b8f8-0087c4ca4db1 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 178,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2f662f1f-f63a-550a-b8f8-0087c4ca4db1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SJ69KPZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116997220',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'KIA',
 'model': 'SPORTAGE ESTATE',
 'odometer': 114114,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-31',
 'seller_name': 'Arnold Clark',
 'title': 'KIA SPORTAGE ESTATE 1.6T GDi ISG 2 5dr [AWD]',
 'transmission': 'manual',
 'trim': '1.6T GDi ISG 2 5dr [AWD]',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997220%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Saving data for 116997220: {'auction_closing_time': 1764842400.0, 'created_time': 1762455779.756969, 'last_price_update_time': 1764874826.251447}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116997220') HTTP/1.1" 204 0
2025-12-04 19:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-12-04 19:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ac040797-1bbe-5a68-a3ef-1b65270586ce with identifier: 117058987
2025-12-04 19:00:26 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: ac040797-1bbe-5a68-a3ef-1b65270586ce with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ac040797-1bbe-5a68-a3ef-1b65270586ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72VHR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117058987',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 35708,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-08',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117058987%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Saving data for 117058987: {'auction_closing_time': 1764842400.0, 'created_time': 1764270318.622615, 'last_price_update_time': 1764874826.296188}
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117058987') HTTP/1.1" 204 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116163300
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116163300%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116163300: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 115951209
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951209%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 115951209: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 115951329
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951329%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 115951329: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 115951284
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951284%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 115951284: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117121214
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117121214: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117507998
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507998%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117507998: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117660087
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660087%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117660087: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117131446
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117131446: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117243071
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117243071: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117131404
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117131404: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024058
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024058: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117024353
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117024353: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117662383
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662383%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117662383: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117288542
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117288542: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117662079
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662079%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117662079: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116872991
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116872991: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117421105
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117421105: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117554620
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117554620: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117407455
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117407455: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117479539
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117479539%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117479539: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117517620
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117517620: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 116419349
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116419349%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 116419349: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117122763
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117122763: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117600118
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600118%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117600118: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117316150
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117316150: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117600165
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600165%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117600165: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117268826
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117268826%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117268826: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117496386
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117496386%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117496386: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117584328
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584328%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117584328: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117488530
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117488530%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117488530: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117584319
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584319%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117584319: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117407486
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117407486: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117554606
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117554606: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117554753
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117554753: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117584272
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584272%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117584272: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117584261
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584261%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117584261: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117144969
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144969%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117144969: 0
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117407792
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Scrape type for 117407792: 2
2025-12-04 19:00:26 [astonbarclay.gb] INFO: Found listing with ID: 117517722
2025-12-04 19:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117517722: 2
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117662061
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662061%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117662061: 0
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117316133
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117316133: 2
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117103708?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117117971
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117117971%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117117971: 0
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117581980
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581980%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117581980: 0
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117554544
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117554544: 2
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116831775?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117548403
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548403%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117548403: 0
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117548415
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548415%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117548415: 0
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117589537
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589537%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117589537: 2
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117222053?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117507367
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507367%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117507367: 2
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116827121?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117103708, 'registration': 'SM19HMK', 'account': 'DAY005', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '110kW Tekna 40kWh 5dr Auto', 'mileage': 11391, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 3, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-07', 'fuel': 'Electric', 'motExpiry': '2026-05-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SM19HMK/2025-12-03/image/d721ea7a-3146-47a3-b32b-511f3f225429_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/338242c7-c16f-4a0e-8be7-2047356ac33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/fa82cb57-7f30-46e5-b685-b4b1fb961251_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/08976ee8-8ef1-49d9-8cb4-f88de0e96a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/5ef72061-f488-4cba-91ef-9a6671bd5a29_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/f8498bb3-4787-472d-a3c1-3509cabc8aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/5f5a7147-abfa-43ed-a345-b2839787614b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/be248647-9fe2-4360-94b7-d1e10f89bfce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/31300232-f8db-4549-8053-0bd38e496dfa_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**1843** VOSA STATES 3K, 6K, 9K, 10K  SPARE KEY CHARGING LEAD', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1e47d4b-a818-4ea5-9678-c96171ebd35e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117103708, 'registration': 'SM19HMK', 'account': 'DAY005', 'make': 'NISSAN', 'model': 'LEAF HATCHBACK', 'derivative': '110kW Tekna 40kWh 5dr Auto', 'mileage': 11391, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 3, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-05-07', 'fuel': 'Electric', 'motExpiry': '2026-05-06', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SM19HMK/2025-12-03/image/d721ea7a-3146-47a3-b32b-511f3f225429_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/338242c7-c16f-4a0e-8be7-2047356ac33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/fa82cb57-7f30-46e5-b685-b4b1fb961251_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/08976ee8-8ef1-49d9-8cb4-f88de0e96a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/5ef72061-f488-4cba-91ef-9a6671bd5a29_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/f8498bb3-4787-472d-a3c1-3509cabc8aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/5f5a7147-abfa-43ed-a345-b2839787614b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/be248647-9fe2-4360-94b7-d1e10f89bfce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SM19HMK/2025-12-03/image/31300232-f8db-4549-8053-0bd38e496dfa_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE', 'remarks': '**1843** VOSA STATES 3K, 6K, 9K, 10K  SPARE KEY CHARGING LEAD', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b1e47d4b-a818-4ea5-9678-c96171ebd35e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efb4d1d4-5e6d-5815-b002-2936cd9cd377 with identifier: 117103708
2025-12-04 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efb4d1d4-5e6d-5815-b002-2936cd9cd377 with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efb4d1d4-5e6d-5815-b002-2936cd9cd377 with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: efb4d1d4-5e6d-5815-b002-2936cd9cd377, identifier: 117103708
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117522892
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522892%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117522892: 2
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117446295?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: efb4d1d4-5e6d-5815-b002-2936cd9cd377 with identifier: 117103708
2025-12-04 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: efb4d1d4-5e6d-5815-b002-2936cd9cd377 with identifier: 117103708
2025-12-04 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'nissan leaf hatchback 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11391, 'odometer_reading_unit': 'mi', 'registration_date': '2019-05-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103708', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'sm19hmk', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'efb4d1d4-5e6d-5815-b002-2936cd9cd377', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'nissan leaf hatchback', 'sanitized_make': 'nissan', 'odometer_in_km': 18331} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'efb4d1d4-5e6d-5815-b002-2936cd9cd377',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sm19hmk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103708',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'nissan',
     'make_model': 'nissan leaf hatchback',
     'model': 'leaf hatchback',
     'odometer': 11391,
     'odometer_in_km': 18331,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-05-07',
     'sanitized_make': 'nissan',
     'seller_name': 'days fleet',
     'title': 'nissan leaf hatchback 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'vin': None,
     'year': 2019}
2025-12-04 19:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: efb4d1d4-5e6d-5815-b002-2936cd9cd377 spider: astonbarclay.gb
2025-12-04 19:00:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: efb4d1d4-5e6d-5815-b002-2936cd9cd377 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'days fleet', 'price_includes_vat': False, 'title': 'nissan leaf hatchback 110kw tekna 40kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'nissan', 'model': 'leaf hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 11391, 'odometer_reading_unit': 'mi', 'registration_date': '2019-05-07', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103708', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '110kw tekna 40kwh 5dr auto', 'license_plate': 'sm19hmk', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'efb4d1d4-5e6d-5815-b002-2936cd9cd377', 'current_year_diff': 6, 'age_in_months': 78, 'make_model': 'nissan leaf hatchback', 'sanitized_make': 'nissan', 'odometer_in_km': 18331} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 78,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': 'efb4d1d4-5e6d-5815-b002-2936cd9cd377',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sm19hmk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103708',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'nissan',
     'make_model': 'nissan leaf hatchback',
     'model': 'leaf hatchback',
     'odometer': 11391,
     'odometer_in_km': 18331,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-05-07',
     'sanitized_make': 'nissan',
     'seller_name': 'days fleet',
     'title': 'nissan leaf hatchback 110kw tekna 40kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '110kw tekna 40kwh 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'efb4d1d4-5e6d-5815-b002-2936cd9cd377',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SM19HMK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117103708',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'LEAF HATCHBACK',
 'odometer': 11391,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-07',
 'seller_name': 'Days Fleet',
 'title': 'NISSAN LEAF HATCHBACK 110kW Tekna 40kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '110kW Tekna 40kWh 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117103708%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Saving data for 117103708: {'auction_closing_time': 1764927900.0, 'created_time': 1764184315.955997, 'last_price_update_time': 1764874827.623982}
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117103708') HTTP/1.1" 204 0
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Found listing with ID: 117507378
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507378%27 HTTP/1.1" 200 None
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Scrape type for 117507378: 2
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117339782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116183620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117209040?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116831775, 'registration': 'GU72VBD', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 30058, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 13, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-14', 'fuel': 'Electric', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VBD/2025-10-31/image/7f5b8c00-7225-4875-a52b-591855212375_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/ba8241d6-18e5-48b1-9af5-bfde6e0297b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/bdae992d-3022-42b3-90ef-54c3d068108a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/554cdee7-67a5-4dbd-8e05-da26daad9184_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/d2de26c8-dd6b-4412-bbaf-d812f96d1689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/7d5bc278-33d7-489e-8527-00e357ea7277_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/593b40d9-ae84-49ad-8766-e30fa796c060_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/2e6c056b-5f01-4f90-8ece-8efc7479f596_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/6626893a-c9b2-4a27-8bbc-22715c4cf3cd_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23-3K, 10/24- 16K, 09/25- 28K', 'remarks': '**370**  VOSA STATES 28K  SPARE KEY  CHARGING CABLE - / Leather - Black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4531e4d3-ef58-4f8b-9f7c-8a44ab74e307.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116831775, 'registration': 'GU72VBD', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 30058, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 13, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-10-14', 'fuel': 'Electric', 'motExpiry': '2026-10-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72VBD/2025-10-31/image/7f5b8c00-7225-4875-a52b-591855212375_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/ba8241d6-18e5-48b1-9af5-bfde6e0297b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/bdae992d-3022-42b3-90ef-54c3d068108a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/554cdee7-67a5-4dbd-8e05-da26daad9184_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/d2de26c8-dd6b-4412-bbaf-d812f96d1689_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/7d5bc278-33d7-489e-8527-00e357ea7277_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/593b40d9-ae84-49ad-8766-e30fa796c060_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/2e6c056b-5f01-4f90-8ece-8efc7479f596_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72VBD/2025-10-31/image/6626893a-c9b2-4a27-8bbc-22715c4cf3cd_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23-3K, 10/24- 16K, 09/25- 28K', 'remarks': '**370**  VOSA STATES 28K  SPARE KEY  CHARGING CABLE - / Leather - Black', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4531e4d3-ef58-4f8b-9f7c-8a44ab74e307.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a with identifier: 116831775
2025-12-04 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77205c46-5c0f-5f74-9d91-561fb1ab7d9a with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77205c46-5c0f-5f74-9d91-561fb1ab7d9a with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a, identifier: 116831775
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117222053, 'registration': 'BT72NUH', 'account': 'DAY005', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '2.0 Hybrid Design 5dr CVT', 'mileage': 28167, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 2, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-18', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7961d8cf-66d0-4adf-b4d2-53a9e1904b26_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7a0931a3-3fb9-4cfc-b74c-a1252635fb9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/94682813-df51-4883-b201-a484ae8f52c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/46461796-f22f-44fa-b364-75f6142164fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/5f26b7c8-1362-4c9d-8755-458a7e8fe0d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/33bf1239-2703-435d-a7a4-9787e4dbb02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/949001eb-f014-40ac-87fe-f5b6e0973b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7c5d340e-d7c5-4ff6-8d67-2f19fe7e74ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/ed20a738-8ca7-43d1-9dd8-7893fabf4394_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/25- 20K', 'remarks': '**1495**VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1db7af6d-e9ce-4120-ac20-a734eecb9a0f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117222053, 'registration': 'BT72NUH', 'account': 'DAY005', 'make': 'TOYOTA', 'model': 'C-HR HATCHBACK', 'derivative': '2.0 Hybrid Design 5dr CVT', 'mileage': 28167, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 2, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-18', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1987, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7961d8cf-66d0-4adf-b4d2-53a9e1904b26_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7a0931a3-3fb9-4cfc-b74c-a1252635fb9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/94682813-df51-4883-b201-a484ae8f52c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/46461796-f22f-44fa-b364-75f6142164fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/5f26b7c8-1362-4c9d-8755-458a7e8fe0d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/33bf1239-2703-435d-a7a4-9787e4dbb02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/949001eb-f014-40ac-87fe-f5b6e0973b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/7c5d340e-d7c5-4ff6-8d67-2f19fe7e74ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT72NUH/2025-11-24/image/ed20a738-8ca7-43d1-9dd8-7893fabf4394_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 02/25- 20K', 'remarks': '**1495**VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1db7af6d-e9ce-4120-ac20-a734eecb9a0f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89d84adb-7010-5fe8-b9d9-c37e582aa80b with identifier: 117222053
2025-12-04 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89d84adb-7010-5fe8-b9d9-c37e582aa80b with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89d84adb-7010-5fe8-b9d9-c37e582aa80b with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89d84adb-7010-5fe8-b9d9-c37e582aa80b, identifier: 117222053
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116827121, 'registration': 'RE22XNF', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 35105, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 11, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-06-21', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22XNF/2025-10-31/image/ce915db1-b185-4396-9320-1e7082c9ae5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/c0c104f4-e6a8-4f12-8f7a-e0f9aa41b329_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/927bd347-8648-407f-99f5-d17b469abe5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/905db2b1-b779-4cc5-96f4-52c968bee1ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/a24b887a-8b04-414e-b24b-59b1896cfd09_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/4754f551-8bce-4fd6-b606-23b145120976_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/61bd09f1-798e-409a-8c50-cab51fe2dc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/78c05a7c-038e-4062-8ebc-aa5acf4d1da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/95c5d092-c1e2-41d5-b833-ac6a0fc19ea7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**214**VOSA STATES 31K  SPARE KEY - / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/12e88528-4304-4eab-aa59-2db8e34aba34.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116827121, 'registration': 'RE22XNF', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 35105, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 11, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-06-22', 'fuel': 'Diesel', 'motExpiry': '2026-06-21', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22XNF/2025-10-31/image/ce915db1-b185-4396-9320-1e7082c9ae5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/c0c104f4-e6a8-4f12-8f7a-e0f9aa41b329_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/927bd347-8648-407f-99f5-d17b469abe5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/905db2b1-b779-4cc5-96f4-52c968bee1ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/a24b887a-8b04-414e-b24b-59b1896cfd09_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/4754f551-8bce-4fd6-b606-23b145120976_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/61bd09f1-798e-409a-8c50-cab51fe2dc67_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/78c05a7c-038e-4062-8ebc-aa5acf4d1da0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22XNF/2025-10-31/image/95c5d092-c1e2-41d5-b833-ac6a0fc19ea7_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'NO SERVICE HISTORY', 'remarks': '**214**VOSA STATES 31K  SPARE KEY - / Maze cloth - Soul / Metallic - Atlantic blue', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/12e88528-4304-4eab-aa59-2db8e34aba34.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with identifier: 116827121
2025-12-04 19:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with scrape type 2
2025-12-04 19:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with scrape type 2
2025-12-04 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5a802254-79f3-5ff7-aa3b-2bde454a3d31, identifier: 116827121
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117446295, 'registration': 'DC23JSX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21795, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 290, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JSX/2025-11-27/image/5f80aa6e-28ef-46db-95bd-e5181dcc3b9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/d14aafcf-5c75-4857-a6c3-8271aebf3296_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/4dfbfd50-925f-4a88-924c-54da36bc5d22_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/efc0032f-5e9d-4893-ba79-9e922d7bb8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/419250f6-3f5a-4762-b6b6-d44b112e8609_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/b0208d1a-7a63-4e70-96ee-01872efc6004_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/c35bd089-bbd7-4721-aa3c-08e0e9fda40a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/7b298c58-3614-4543-878f-15ba29e42d80_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fd80faa3-cfcd-48ce-88b3-cb9cfd0d3323.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117446295, 'registration': 'DC23JSX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 21795, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 290, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JSX/2025-11-27/image/5f80aa6e-28ef-46db-95bd-e5181dcc3b9b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/d14aafcf-5c75-4857-a6c3-8271aebf3296_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/4dfbfd50-925f-4a88-924c-54da36bc5d22_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/efc0032f-5e9d-4893-ba79-9e922d7bb8c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/419250f6-3f5a-4762-b6b6-d44b112e8609_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/b0208d1a-7a63-4e70-96ee-01872efc6004_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/c35bd089-bbd7-4721-aa3c-08e0e9fda40a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JSX/2025-11-27/image/7b298c58-3614-4543-878f-15ba29e42d80_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fd80faa3-cfcd-48ce-88b3-cb9cfd0d3323.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4388f85-8706-55a3-aa9d-c0ac248cbd84 with identifier: 117446295
2025-12-04 19:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4388f85-8706-55a3-aa9d-c0ac248cbd84 with scrape type 2
2025-12-04 19:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4388f85-8706-55a3-aa9d-c0ac248cbd84 with scrape type 2
2025-12-04 19:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b4388f85-8706-55a3-aa9d-c0ac248cbd84, identifier: 117446295
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117589550
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589550%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117589550: 0
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117740684
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740684%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117740684: 0
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117623142
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623142%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117623142: 0
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117623154
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623154%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117623154: 0
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Found listing with ID: 117507387
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507387%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Scrape type for 117507387: 2
2025-12-04 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a with identifier: 116831775
2025-12-04 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a with identifier: 116831775
2025-12-04 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30058, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831775', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vbd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '77205c46-5c0f-5f74-9d91-561fb1ab7d9a', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 48373} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': '77205c46-5c0f-5f74-9d91-561fb1ab7d9a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vbd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831775',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 30058,
     'odometer_in_km': 48373,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a spider: astonbarclay.gb
2025-12-04 19:00:28 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 77205c46-5c0f-5f74-9d91-561fb1ab7d9a due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30058, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831775', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72vbd', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '77205c46-5c0f-5f74-9d91-561fb1ab7d9a', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 48373} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': '77205c46-5c0f-5f74-9d91-561fb1ab7d9a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72vbd',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831775',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 30058,
     'odometer_in_km': 48373,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '77205c46-5c0f-5f74-9d91-561fb1ab7d9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72VBD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116831775',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 30058,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-14',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831775%27 HTTP/1.1" 200 None
2025-12-04 19:00:28 [astonbarclay.gb] INFO: Saving data for 116831775: {'auction_closing_time': 1764927900.0, 'created_time': 1762801426.329115, 'last_price_update_time': 1764874828.571484}
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116831775') HTTP/1.1" 204 0
2025-12-04 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89d84adb-7010-5fe8-b9d9-c37e582aa80b with identifier: 117222053
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric+Hybrid HTTP/1.1" 200 None
2025-12-04 19:00:28 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89d84adb-7010-5fe8-b9d9-c37e582aa80b with identifier: 117222053
2025-12-04 19:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 89d84adb-7010-5fe8-b9d9-c37e582aa80b with identifier: 117222053 to the API
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2789d84adb-7010-5fe8-b9d9-c37e582aa80b%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 89d84adb-7010-5fe8-b9d9-c37e582aa80b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117222053?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '89d84adb-7010-5fe8-b9d9-c37e582aa80b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BT72NUH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117222053',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TOYOTA',
 'model': 'C-HR HATCHBACK',
 'odometer': 28167,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-18',
 'seller_name': 'Days Fleet',
 'title': 'TOYOTA C-HR HATCHBACK 2.0 Hybrid Design 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.0 Hybrid Design 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117222053%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Saving data for 117222053: {'auction_closing_time': 1764927900.0, 'created_time': 1763751827.288453, 'last_price_update_time': 1764874829.065502}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117222053') HTTP/1.1" 204 0
2025-12-04 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with identifier: 116827121
2025-12-04 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with identifier: 116827121
2025-12-04 19:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5a802254-79f3-5ff7-aa3b-2bde454a3d31 with identifier: 116827121 to the API
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116827121?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '5a802254-79f3-5ff7-aa3b-2bde454a3d31',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22XNF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116827121',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 35105,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-22',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116827121%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Saving data for 116827121: {'auction_closing_time': 1764927900.0, 'created_time': 1762801423.36099, 'last_price_update_time': 1764874829.641316}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116827121') HTTP/1.1" 204 0
2025-12-04 19:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b4388f85-8706-55a3-aa9d-c0ac248cbd84 with identifier: 117446295
2025-12-04 19:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b4388f85-8706-55a3-aa9d-c0ac248cbd84 with identifier: 117446295
2025-12-04 19:00:29 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b4388f85-8706-55a3-aa9d-c0ac248cbd84 with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b4388f85-8706-55a3-aa9d-c0ac248cbd84',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117446295',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 21795,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117446295%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Saving data for 117446295: {'auction_closing_time': 1764842400.0, 'created_time': 1764184267.472039, 'last_price_update_time': 1764874829.677546}
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117446295') HTTP/1.1" 204 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117579304
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579304%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117579304: 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117579278
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579278%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117579278: 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117579253
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117579253%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117579253: 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117580116
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580116%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117580116: 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117642793
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642793%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117642793: 0
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Found listing with ID: 117584754
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584754%27 HTTP/1.1" 200 None
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Scrape type for 117584754: 2
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117339782, 'registration': 'RF22XJK', 'account': 'TCH001', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Executive 4dr Tip Auto', 'mileage': 23250, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 17, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-14', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/RF22XJK/2025-11-19/image/95831d12-ce46-4fbf-b3a1-e8b4e663f4f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/5e0590fc-26ea-45e6-932f-aa7644d941ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/76a78e1a-03c5-4e4b-ac92-455c6132874e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/750f6f93-7efb-4ff2-994c-636edf51b73b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/ccdc40a8-e394-4eef-9927-cc050f81fad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/f83f1720-3bfb-41cc-8cf7-417635b5ee0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/4e7d4430-37bb-4837-ba78-f4f1697f7930_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/5a371606-29d4-4073-8faa-26a9b90dc741_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/46ffb701-09e4-4cac-ab30-9e92ddac2aaa_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23-10K', 'remarks': '**1951** VOSA STATES 22K, SPARE KEY', 'virtual': False, 'seller': 'TCH Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aaf6cb40-ea63-4418-89a4-84190c78acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117339782, 'registration': 'RF22XJK', 'account': 'TCH001', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 180 AMG Line Executive 4dr Tip Auto', 'mileage': 23250, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 17, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-14', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/RF22XJK/2025-11-19/image/95831d12-ce46-4fbf-b3a1-e8b4e663f4f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/5e0590fc-26ea-45e6-932f-aa7644d941ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/76a78e1a-03c5-4e4b-ac92-455c6132874e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/750f6f93-7efb-4ff2-994c-636edf51b73b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/ccdc40a8-e394-4eef-9927-cc050f81fad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/f83f1720-3bfb-41cc-8cf7-417635b5ee0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/4e7d4430-37bb-4837-ba78-f4f1697f7930_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/5a371606-29d4-4073-8faa-26a9b90dc741_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF22XJK/2025-11-19/image/46ffb701-09e4-4cac-ab30-9e92ddac2aaa_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/23-10K', 'remarks': '**1951** VOSA STATES 22K, SPARE KEY', 'virtual': False, 'seller': 'TCH Leasing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aaf6cb40-ea63-4418-89a4-84190c78acd5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a87447ea-3b56-5471-99a0-66d0ac2c32ab with identifier: 117339782
2025-12-04 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a87447ea-3b56-5471-99a0-66d0ac2c32ab with scrape type 2
2025-12-04 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a87447ea-3b56-5471-99a0-66d0ac2c32ab with scrape type 2
2025-12-04 19:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a87447ea-3b56-5471-99a0-66d0ac2c32ab, identifier: 117339782
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116183620, 'registration': 'GU72YKO', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23580, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 224, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-22', 'fuel': 'Electric', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKO/2025-10-09/image/0fbd766b-3873-42fc-aac6-4decc05b3da9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/42455cb4-3596-45b1-8114-260737317b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/3bd1fe80-07c5-41db-94fb-67af90359946_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/833557f8-fb44-486f-bae6-90d3cdc1ac96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/bf1b9c05-aa66-4643-9399-170dae035a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/c051b69f-f485-49c7-a640-fd74daa29e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/1f1b4ba6-4fa7-479c-a3e4-f28795ea4a05_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/fdb9a493-21c0-47c6-a25c-cc9b13090a79_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23-8K, 09/24-16K, 09/25-22K,', 'remarks': 'vosa states 22k, SPARE KEY, *Metallic - Obsidian black, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/603405fd-b4a1-425c-89af-b3332f283e74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116183620, 'registration': 'GU72YKO', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 23580, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 224, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-22', 'fuel': 'Electric', 'motExpiry': '2026-09-21', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72YKO/2025-10-09/image/0fbd766b-3873-42fc-aac6-4decc05b3da9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/42455cb4-3596-45b1-8114-260737317b3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/3bd1fe80-07c5-41db-94fb-67af90359946_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/833557f8-fb44-486f-bae6-90d3cdc1ac96_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/bf1b9c05-aa66-4643-9399-170dae035a95_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/c051b69f-f485-49c7-a640-fd74daa29e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/1f1b4ba6-4fa7-479c-a3e4-f28795ea4a05_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72YKO/2025-10-09/image/fdb9a493-21c0-47c6-a25c-cc9b13090a79_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 09/23-8K, 09/24-16K, 09/25-22K,', 'remarks': 'vosa states 22k, SPARE KEY, *Metallic - Obsidian black, Leather - Black*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/603405fd-b4a1-425c-89af-b3332f283e74.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-12-04 19:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c543584-df90-5d7e-9e5b-05dcfea64fca with scrape type 2
2025-12-04 19:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c543584-df90-5d7e-9e5b-05dcfea64fca with scrape type 2
2025-12-04 19:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1c543584-df90-5d7e-9e5b-05dcfea64fca, identifier: 116183620
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117209040, 'registration': 'KM72EJJ', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '125kW Premium 58 kWh 5dr Auto', 'mileage': 52656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 211, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-23k, 02/25-41k,', 'remarks': 'SPARE KEY, *Metallic - Galactic grey, Cloth - Pixel perfect grey*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4426de3c-62ba-4f8f-854e-cce5cfc132de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117209040, 'registration': 'KM72EJJ', 'account': 'KIN032', 'make': 'HYUNDAI', 'model': 'IONIQ 5 ELECTRIC HATCHBACK', 'derivative': '125kW Premium 58 kWh 5dr Auto', 'mileage': 52656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17976, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-04T10:00Z', 'lot': 211, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-11-04', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bc1183b3-47ad-4470-b027-4f345f02d902_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/cb25e0d2-e430-436b-99c0-7faac1dd6461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/f0916d60-5a4b-4d08-95a9-1d24e5eb0769_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/bf22658e-e743-40bb-b0d7-441c68b0df42_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/74e5904b-8830-4ba3-aa9b-7d9f6ebef578_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/1aa824a2-d083-4140-850e-7feb6ac9ac12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/4c873fe9-533d-441a-b905-d2b94690b6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM72EJJ/2025-11-14/image/0de67a17-eb4c-4991-abd3-d625ae01aae1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 03/24-23k, 02/25-41k,', 'remarks': 'SPARE KEY, *Metallic - Galactic grey, Cloth - Pixel perfect grey*', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4426de3c-62ba-4f8f-854e-cce5cfc132de.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-12-04 19:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a41ae796-efd0-5c70-b725-bddc08ebb3fd with scrape type 2
2025-12-04 19:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a41ae796-efd0-5c70-b725-bddc08ebb3fd with scrape type 2
2025-12-04 19:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a41ae796-efd0-5c70-b725-bddc08ebb3fd, identifier: 117209040
2025-12-04 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a87447ea-3b56-5471-99a0-66d0ac2c32ab with identifier: 117339782
2025-12-04 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a87447ea-3b56-5471-99a0-66d0ac2c32ab with identifier: 117339782
2025-12-04 19:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a87447ea-3b56-5471-99a0-66d0ac2c32ab with identifier: 117339782 to the API
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117339782?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a87447ea-3b56-5471-99a0-66d0ac2c32ab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RF22XJK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117339782',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 23250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-24',
 'seller_name': 'TCH Leasing',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 180 AMG Line Executive 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 180 AMG Line Executive 4dr Tip Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117339782%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Saving data for 117339782: {'auction_closing_time': 1764927900.0, 'created_time': 1763578871.33889, 'last_price_update_time': 1764874830.440087}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117339782') HTTP/1.1" 204 0
2025-12-04 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-12-04 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1c543584-df90-5d7e-9e5b-05dcfea64fca with identifier: 116183620
2025-12-04 19:00:30 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 1c543584-df90-5d7e-9e5b-05dcfea64fca with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '1c543584-df90-5d7e-9e5b-05dcfea64fca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72YKO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116183620',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 23580,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-22',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116183620%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Saving data for 116183620: {'auction_closing_time': 1764842400.0, 'created_time': 1763147064.726393, 'last_price_update_time': 1764874830.569763}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116183620') HTTP/1.1" 204 0
2025-12-04 19:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-12-04 19:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a41ae796-efd0-5c70-b725-bddc08ebb3fd with identifier: 117209040
2025-12-04 19:00:30 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: a41ae796-efd0-5c70-b725-bddc08ebb3fd with expiration date: 2025-12-04T10:00:00Z
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-04T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'a41ae796-efd0-5c70-b725-bddc08ebb3fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KM72EJJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117209040',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'HYUNDAI',
 'model': 'IONIQ 5 ELECTRIC HATCHBACK',
 'odometer': 52656,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seller_name': 'Kinto',
 'title': 'HYUNDAI IONIQ 5 ELECTRIC HATCHBACK 125kW Premium 58 kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '125kW Premium 58 kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117209040%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Saving data for 117209040: {'auction_closing_time': 1764842400.0, 'created_time': 1764270305.952535, 'last_price_update_time': 1764874830.619932}
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117209040') HTTP/1.1" 204 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117397605
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117397605%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117397605: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117444820
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444820%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117444820: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117609437
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117609437%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117609437: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117601450
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601450%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117601450: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117740649
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740649%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117740649: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117580238
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580238%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117580238: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117573137
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573137%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117573137: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117681911
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681911%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117681911: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117622575
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117622575%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117622575: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117573681
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573681%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117573681: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117701765
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117701765%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117701765: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117662832
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662832%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117662832: 1
2025-12-04 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117120537?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117597555
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117597555%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117597555: 0
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117599215
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599215%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117599215: 2
2025-12-04 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117183441?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117188811?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117407202
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407202%27 HTTP/1.1" 200 None
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Scrape type for 117407202: 2
2025-12-04 19:00:30 [astonbarclay.gb] INFO: Found listing with ID: 117272138
2025-12-04 19:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272138%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117272138: 2
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117418330
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418330%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117418330: 2
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117061252
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061252%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117061252: 2
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117366956
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366956%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117366956: 2
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117120537, 'registration': 'LP21EBD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI Sport 5dr', 'mileage': 22401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 78, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP21EBD/2025-11-27/image/7df6c980-1920-4688-a674-0b56677907cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/896827da-a5cc-47ee-b7d7-3ce470498225_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/36a42ae1-8f88-4e6a-b7b7-26feaaa0f0cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/0cdb2f88-c990-4bb1-b8e3-264ffe9a5200_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/ece92457-4f8f-4b85-ba97-f2a893fb5ae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/1bdce595-e615-48a6-ac96-ed16c8260498_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/f68c9b82-13f7-467d-9335-6bcfa9274107_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/78beba22-697c-45a2-9ac7-2d691b2d0832_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/3e8374dd-2982-46ac-b248-d14e769d7e20_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 11K, 04/25- 19K', 'remarks': '**846**VOSA STATES 21K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccd65a9-d7e2-4e3c-b5fa-a41304330464.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117120537, 'registration': 'LP21EBD', 'account': 'ZEN002', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '30 TFSI Sport 5dr', 'mileage': 22401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 78, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-07-09', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP21EBD/2025-11-27/image/7df6c980-1920-4688-a674-0b56677907cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/896827da-a5cc-47ee-b7d7-3ce470498225_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/36a42ae1-8f88-4e6a-b7b7-26feaaa0f0cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/0cdb2f88-c990-4bb1-b8e3-264ffe9a5200_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/ece92457-4f8f-4b85-ba97-f2a893fb5ae0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/1bdce595-e615-48a6-ac96-ed16c8260498_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/f68c9b82-13f7-467d-9335-6bcfa9274107_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/78beba22-697c-45a2-9ac7-2d691b2d0832_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP21EBD/2025-11-27/image/3e8374dd-2982-46ac-b248-d14e769d7e20_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 11K, 04/25- 19K', 'remarks': '**846**VOSA STATES 21K SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ccd65a9-d7e2-4e3c-b5fa-a41304330464.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c66d571-4acc-557e-89a8-cb2c1cefce2a with identifier: 117120537
2025-12-04 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c66d571-4acc-557e-89a8-cb2c1cefce2a with scrape type 2
2025-12-04 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c66d571-4acc-557e-89a8-cb2c1cefce2a with scrape type 2
2025-12-04 19:00:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c66d571-4acc-557e-89a8-cb2c1cefce2a, identifier: 117120537
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117489691
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489691%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117489691: 2
2025-12-04 19:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c66d571-4acc-557e-89a8-cb2c1cefce2a with identifier: 117120537
2025-12-04 19:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c66d571-4acc-557e-89a8-cb2c1cefce2a with identifier: 117120537
2025-12-04 19:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5c66d571-4acc-557e-89a8-cb2c1cefce2a with identifier: 117120537 to the API
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117120537?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '5c66d571-4acc-557e-89a8-cb2c1cefce2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LP21EBD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117120537',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 22401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-09',
 'seller_name': 'Zenith',
 'title': 'AUDI A3 SPORTBACK 30 TFSI Sport 5dr',
 'transmission': 'manual',
 'trim': '30 TFSI Sport 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120537%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Saving data for 117120537: {'auction_closing_time': 1764927900.0, 'created_time': 1764183943.954105, 'last_price_update_time': 1764874831.770712}
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117120537') HTTP/1.1" 204 0
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Found listing with ID: 117420392
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420392%27 HTTP/1.1" 200 None
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Scrape type for 117420392: 2
2025-12-04 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117019833?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117274004?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117215585?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117180212?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117183441, 'registration': 'YX72XOJ', 'account': 'VAN046', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo Design 5dr', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 29, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/ca3f91e4-6133-480b-a868-4c46e5f16a75_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/26053449-a054-4587-a979-05ea363dab65_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/29a4a064-b5aa-4fd5-9e74-124d6076d34f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/2b8ca45e-4639-41d8-bed5-20cdadf2d656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/aa17170e-926f-4ab1-807c-836496e56f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/4d69741d-56f9-4d96-85be-a56fa359686b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/da3fd45b-1f10-4c8b-857a-3b9a659c6b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/35681b2a-a48b-4b27-b39b-d6c66cc66142_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/0b23d83c-2e9f-4628-ae89-4e94fca0e9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE HISTORY', 'remarks': '**1220**VOSA STATES 8K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/646ab2cc-2823-484b-9aba-7c0d8f1fa493.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117183441, 'registration': 'YX72XOJ', 'account': 'VAN046', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo Design 5dr', 'mileage': 8631, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 29, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-29', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/ca3f91e4-6133-480b-a868-4c46e5f16a75_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/26053449-a054-4587-a979-05ea363dab65_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/29a4a064-b5aa-4fd5-9e74-124d6076d34f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/2b8ca45e-4639-41d8-bed5-20cdadf2d656_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/aa17170e-926f-4ab1-807c-836496e56f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/4d69741d-56f9-4d96-85be-a56fa359686b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/da3fd45b-1f10-4c8b-857a-3b9a659c6b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/35681b2a-a48b-4b27-b39b-d6c66cc66142_removebg.jpg?w=600', 'https://abimg003.imgix.net/YX72XOJ/2025-11-17/image/0b23d83c-2e9f-4628-ae89-4e94fca0e9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book NO SERVICE HISTORY', 'remarks': '**1220**VOSA STATES 8K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 131, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/646ab2cc-2823-484b-9aba-7c0d8f1fa493.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a832a07b-1c09-586c-ae0a-9589cf806f5d with identifier: 117183441
2025-12-04 19:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a832a07b-1c09-586c-ae0a-9589cf806f5d with scrape type 2
2025-12-04 19:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a832a07b-1c09-586c-ae0a-9589cf806f5d with scrape type 2
2025-12-04 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a832a07b-1c09-586c-ae0a-9589cf806f5d, identifier: 117183441
2025-12-04 19:00:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117188811, 'registration': 'MJ71LZL', 'account': 'ZEN009', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.6 Hybrid 225 GT 5dr e-EAT8', 'mileage': 22898, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 72, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1600, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/1141a693-49f0-4b5a-95ae-43acde7dff1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c656a3d5-363d-4365-a4d4-006fcf26fa1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/4b23313f-794e-4d12-a838-87d931022595_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c400bba5-59c4-4202-9466-31687168d431_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c3f4e41d-9ce2-4ee2-ab1b-870111cb4ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/359f26ed-a58e-48a3-86f3-18b29e76e7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/4d490b78-4363-44c0-908a-fec19b1654ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/dddc6a8a-f1a6-4dcf-8f62-e3516da06242_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/38f1d320-d179-4239-966f-fa97de65c9b1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24 - 13K', 'remarks': '**815**VOSA STATES 16K, 21K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9d2ae30-61e5-4170-a1b6-4f3a99a2d5be.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117188811, 'registration': 'MJ71LZL', 'account': 'ZEN009', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.6 Hybrid 225 GT 5dr e-EAT8', 'mileage': 22898, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 72, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-10-31', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': 1600, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/1141a693-49f0-4b5a-95ae-43acde7dff1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c656a3d5-363d-4365-a4d4-006fcf26fa1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/4b23313f-794e-4d12-a838-87d931022595_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c400bba5-59c4-4202-9466-31687168d431_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/c3f4e41d-9ce2-4ee2-ab1b-870111cb4ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/359f26ed-a58e-48a3-86f3-18b29e76e7e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/4d490b78-4363-44c0-908a-fec19b1654ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/dddc6a8a-f1a6-4dcf-8f62-e3516da06242_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71LZL/2025-11-25/image/38f1d320-d179-4239-966f-fa97de65c9b1_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/24 - 13K', 'remarks': '**815**VOSA STATES 16K, 21K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9d2ae30-61e5-4170-a1b6-4f3a99a2d5be.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with identifier: 117188811
2025-12-04 19:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with scrape type 2
2025-12-04 19:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with scrape type 2
2025-12-04 19:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c, identifier: 117188811
2025-12-04 19:00:32 [astonbarclay.gb] INFO: Found listing with ID: 117231043
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231043%27 HTTP/1.1" 200 None
2025-12-04 19:00:32 [astonbarclay.gb] INFO: Scrape type for 117231043: 2
2025-12-04 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a832a07b-1c09-586c-ae0a-9589cf806f5d with identifier: 117183441
2025-12-04 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a832a07b-1c09-586c-ae0a-9589cf806f5d with identifier: 117183441
2025-12-04 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a832a07b-1c09-586c-ae0a-9589cf806f5d with identifier: 117183441 to the API
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117183441?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 131,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'a832a07b-1c09-586c-ae0a-9589cf806f5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YX72XOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117183441',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 8631,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo Design 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Design 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117183441%27 HTTP/1.1" 200 None
2025-12-04 19:00:32 [astonbarclay.gb] INFO: Saving data for 117183441: {'auction_closing_time': 1764927900.0, 'created_time': 1763147137.276336, 'last_price_update_time': 1764874832.472498}
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117183441') HTTP/1.1" 204 0
2025-12-04 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with identifier: 117188811
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FPlugin+Electric+Hybrid HTTP/1.1" 200 None
2025-12-04 19:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with identifier: 117188811
2025-12-04 19:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7f1ab668-b671-5ae6-bc2f-83660a2ebd7c with identifier: 117188811 to the API
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117188811?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '7f1ab668-b671-5ae6-bc2f-83660a2ebd7c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71LZL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117188811',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 22898,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-31',
 'seller_name': 'Zenith',
 'title': 'PEUGEOT 3008 ESTATE 1.6 Hybrid 225 GT 5dr e-EAT8',
 'transmission': 'automatic',
 'trim': '1.6 Hybrid 225 GT 5dr e-EAT8',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188811%27 HTTP/1.1" 200 None
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Saving data for 117188811: {'auction_closing_time': 1764927900.0, 'created_time': 1764183903.255383, 'last_price_update_time': 1764874833.014779}
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117188811') HTTP/1.1" 204 0
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Found listing with ID: 117015819
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Scrape type for 117015819: 2
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117019833, 'registration': 'YE72RYO', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 25037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 80, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-15', 'fuel': 'Petrol', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72RYO/2025-11-12/image/e548b6a7-f59d-41d3-b587-7395397becc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/1aa84fd4-a313-4d0a-a974-edf2363d99f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/9deb2f5d-9530-43c1-9022-5b012b30201c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/026eaf08-963c-4155-a407-668630e319b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/4eba0df0-2a9d-4eae-b5b5-906c71b90851_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/7ecf89fa-c87a-478d-9345-e56e965c7eee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/327ba5fd-686a-4acb-bb41-676a2a90c4c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/861521e1-6ddf-46b2-90aa-690761555499_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/9616f8e6-8d96-4c56-918f-2856697b9b09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25- 18K', 'remarks': '**729**VOSA STATES 24K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29a18d2b-58de-4d5b-923a-e2f898b895be.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117019833, 'registration': 'YE72RYO', 'account': 'ZEN009', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr', 'mileage': 25037, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 80, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2022-11-15', 'fuel': 'Petrol', 'motExpiry': '2026-11-14', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE72RYO/2025-11-12/image/e548b6a7-f59d-41d3-b587-7395397becc5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/1aa84fd4-a313-4d0a-a974-edf2363d99f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/9deb2f5d-9530-43c1-9022-5b012b30201c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/026eaf08-963c-4155-a407-668630e319b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/4eba0df0-2a9d-4eae-b5b5-906c71b90851_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/7ecf89fa-c87a-478d-9345-e56e965c7eee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/327ba5fd-686a-4acb-bb41-676a2a90c4c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/861521e1-6ddf-46b2-90aa-690761555499_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE72RYO/2025-11-12/image/9616f8e6-8d96-4c56-918f-2856697b9b09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/25- 18K', 'remarks': '**729**VOSA STATES 24K, SPARE KEY', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29a18d2b-58de-4d5b-923a-e2f898b895be.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with identifier: 117019833
2025-12-04 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 24f968cc-3bad-5a83-959b-ebeaa416d1d9, identifier: 117019833
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117430085, 'registration': 'BL23UVO', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 33324, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 91, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c22fa9a-eb68-450d-90d4-909443035556.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117430085, 'registration': 'BL23UVO', 'account': 'ZEN009', 'make': 'CUPRA', 'model': 'LEON ESTATE', 'derivative': '1.4 eHybrid VZ2 5dr DSG', 'mileage': 33324, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 91, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2023-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0c22fa9a-eb68-450d-90d4-909443035556.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 19d63544-e049-5468-b6e5-fc2a89322e9b with identifier: 117430085
2025-12-04 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d63544-e049-5468-b6e5-fc2a89322e9b with scrape type 1
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117274004, 'registration': 'NL71HSG', 'account': 'ZEN002', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '100kW 2 39kWh 5dr Auto', 'mileage': 33237, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 62, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-11', 'fuel': 'Electric', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL71HSG/2025-11-27/image/abb113d6-f9c6-4bcf-bf5b-3e10791134d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/76d28109-2866-4b46-a913-aeaf42ab440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/9c26e37f-aa11-476e-9c6f-c8535e46f009_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/039d4d83-9e57-4711-bd13-5570f383f2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/ee48c102-bfed-4fc3-a05c-bbd870850900_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/225e733d-5fe1-4c8a-a2e0-24cd99fad721_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/154f2347-0569-4c5d-8bf1-6771c98d7f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/582a0775-f653-4a0c-ad46-4bfbc9096be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/9dfb245e-c325-471b-a1e3-9048fdb3763b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24-24K, 10/25-32K,', 'remarks': '**816** VOSA STATES 24K, 32K SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6784ddff-2682-43de-87fb-0e36a3adee6a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117274004, 'registration': 'NL71HSG', 'account': 'ZEN002', 'make': 'KIA', 'model': 'E-NIRO ELECTRIC ESTATE', 'derivative': '100kW 2 39kWh 5dr Auto', 'mileage': 33237, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 62, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-11', 'fuel': 'Electric', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/NL71HSG/2025-11-27/image/abb113d6-f9c6-4bcf-bf5b-3e10791134d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/76d28109-2866-4b46-a913-aeaf42ab440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/9c26e37f-aa11-476e-9c6f-c8535e46f009_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/039d4d83-9e57-4711-bd13-5570f383f2b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/ee48c102-bfed-4fc3-a05c-bbd870850900_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/225e733d-5fe1-4c8a-a2e0-24cd99fad721_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/154f2347-0569-4c5d-8bf1-6771c98d7f24_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/582a0775-f653-4a0c-ad46-4bfbc9096be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL71HSG/2025-11-27/image/9dfb245e-c325-471b-a1e3-9048fdb3763b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24-24K, 10/25-32K,', 'remarks': '**816** VOSA STATES 24K, 32K SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6784ddff-2682-43de-87fb-0e36a3adee6a.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c59c453-d9f6-59ef-b343-5d59ea318a90 with identifier: 117274004
2025-12-04 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c59c453-d9f6-59ef-b343-5d59ea318a90 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c59c453-d9f6-59ef-b343-5d59ea318a90 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6c59c453-d9f6-59ef-b343-5d59ea318a90, identifier: 117274004
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117215585, 'registration': 'LG71YOM', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 66004, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 90, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-10', 'fuel': 'Electric', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG71YOM/2025-11-27/image/31aef036-a77c-4223-b6f5-6b88b33b69fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/081394ff-3afc-4cf1-b6fd-d344573e28e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/cc3ad048-7fe1-4d22-8929-005a59ddfb16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/92295835-0697-4101-b51e-fb72163abaaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/e657b3d8-bfea-4063-bc22-a08b516233b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/a0b47339-6616-423c-8232-bfe07ad4421e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/7a863762-a7ce-4485-a257-dad46c1aa102_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/3fac4f1f-92ef-4fb9-9731-dd34799d8332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/0761394a-c05e-4e7f-a4f1-a07864015ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/4f8e0847-a5a6-4d87-a591-dd5c5b20ced0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**849**VOSA STATES 48K, 61K, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5cdd2690-37fe-4ee6-a61a-72514d4ebd6e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117215585, 'registration': 'LG71YOM', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Standard Plus 4dr Auto', 'mileage': 66004, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 90, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-10', 'fuel': 'Electric', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LG71YOM/2025-11-27/image/31aef036-a77c-4223-b6f5-6b88b33b69fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/081394ff-3afc-4cf1-b6fd-d344573e28e1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/cc3ad048-7fe1-4d22-8929-005a59ddfb16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/92295835-0697-4101-b51e-fb72163abaaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/e657b3d8-bfea-4063-bc22-a08b516233b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/a0b47339-6616-423c-8232-bfe07ad4421e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/7a863762-a7ce-4485-a257-dad46c1aa102_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/3fac4f1f-92ef-4fb9-9731-dd34799d8332_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/0761394a-c05e-4e7f-a4f1-a07864015ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LG71YOM/2025-11-27/image/4f8e0847-a5a6-4d87-a591-dd5c5b20ced0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**849**VOSA STATES 48K, 61K, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5cdd2690-37fe-4ee6-a61a-72514d4ebd6e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a829217-3c1c-5d17-b800-6a8f5d857226 with identifier: 117215585
2025-12-04 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a829217-3c1c-5d17-b800-6a8f5d857226 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a829217-3c1c-5d17-b800-6a8f5d857226 with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7a829217-3c1c-5d17-b800-6a8f5d857226, identifier: 117215585
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117180212, 'registration': 'MJ71YZR', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 62304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-15', 'fuel': 'Electric', 'motExpiry': '2026-10-06', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/95ed55f2-8689-43cb-a1b5-42f9d7677dd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/2d88e3e5-e01c-4736-91cb-de7475f32a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/59062442-d0bb-4b76-9e98-c4d3055bdaad_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/6857f45f-2a89-49d3-add8-66056c9cab05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/607360c2-b79d-4ada-95b3-7d3b4683f33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/c03e68f2-7796-42d6-8fde-bd3ebdecf8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/74bdbb43-4be6-4e66-a214-30f39d55c8aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/5591f041-f231-47b9-970c-e7d9af734afb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/8f2dc937-f241-4ca5-88a6-1717cb2cfe3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/e10c22dd-1ec4-4dcd-acd4-8b15321d05d5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**955**VOSA STATES 46K, 61K SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13caaed8-3389-46da-aeba-da8fb1c376a7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117180212, 'registration': 'MJ71YZR', 'account': 'ZEN002', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Long Range AWD 4dr Auto', 'mileage': 62304, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 86, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-15', 'fuel': 'Electric', 'motExpiry': '2026-10-06', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/95ed55f2-8689-43cb-a1b5-42f9d7677dd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/2d88e3e5-e01c-4736-91cb-de7475f32a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/59062442-d0bb-4b76-9e98-c4d3055bdaad_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/6857f45f-2a89-49d3-add8-66056c9cab05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/607360c2-b79d-4ada-95b3-7d3b4683f33b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/c03e68f2-7796-42d6-8fde-bd3ebdecf8c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/74bdbb43-4be6-4e66-a214-30f39d55c8aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/5591f041-f231-47b9-970c-e7d9af734afb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/8f2dc937-f241-4ca5-88a6-1717cb2cfe3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ71YZR/2025-11-20/image/e10c22dd-1ec4-4dcd-acd4-8b15321d05d5_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**955**VOSA STATES 46K, 61K SPARE KEY, CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13caaed8-3389-46da-aeba-da8fb1c376a7.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae880481-ee45-55c7-b39c-03c28599f30b with identifier: 117180212
2025-12-04 19:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae880481-ee45-55c7-b39c-03c28599f30b with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ae880481-ee45-55c7-b39c-03c28599f30b with scrape type 2
2025-12-04 19:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ae880481-ee45-55c7-b39c-03c28599f30b, identifier: 117180212
2025-12-04 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with identifier: 117019833
2025-12-04 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with identifier: 117019833
2025-12-04 19:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 24f968cc-3bad-5a83-959b-ebeaa416d1d9 with identifier: 117019833 to the API
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117019833?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '24f968cc-3bad-5a83-959b-ebeaa416d1d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YE72RYO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117019833',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 25037,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-15',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH N-Connecta [Glass Roof] 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117019833%27 HTTP/1.1" 200 None
2025-12-04 19:00:33 [astonbarclay.gb] INFO: Saving data for 117019833: {'auction_closing_time': 1764927900.0, 'created_time': 1763492925.262094, 'last_price_update_time': 1764874833.847897}
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117019833') HTTP/1.1" 204 0
2025-12-04 19:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6c59c453-d9f6-59ef-b343-5d59ea318a90 with identifier: 117274004
2025-12-04 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6c59c453-d9f6-59ef-b343-5d59ea318a90 with identifier: 117274004
2025-12-04 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 100kw 2 39kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33237, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-11', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274004', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '100kw 2 39kwh 5dr auto', 'license_plate': 'nl71hsg', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6c59c453-d9f6-59ef-b343-5d59ea318a90', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 53489} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': '6c59c453-d9f6-59ef-b343-5d59ea318a90',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nl71hsg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274004',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 33237,
     'odometer_in_km': 53489,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-11',
     'sanitized_make': 'kia',
     'seller_name': 'zenith',
     'title': 'kia e-niro electric estate 100kw 2 39kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw 2 39kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-04 19:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 6c59c453-d9f6-59ef-b343-5d59ea318a90 spider: astonbarclay.gb
2025-12-04 19:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6c59c453-d9f6-59ef-b343-5d59ea318a90 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'red', 'original_photo_count': 0, 'seller_name': 'zenith', 'price_includes_vat': False, 'title': 'kia e-niro electric estate 100kw 2 39kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'kia', 'model': 'e-niro electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 33237, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-11', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274004', 'expiration_date': '2025-12-05t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '100kw 2 39kwh 5dr auto', 'license_plate': 'nl71hsg', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '6c59c453-d9f6-59ef-b343-5d59ea318a90', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'kia e-niro electric estate', 'sanitized_make': 'kia', 'odometer_in_km': 53489} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'red',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t09:45:00z',
     'fuel_type': 'electric',
     'id': '6c59c453-d9f6-59ef-b343-5d59ea318a90',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'nl71hsg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274004',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'kia',
     'make_model': 'kia e-niro electric estate',
     'model': 'e-niro electric estate',
     'odometer': 33237,
     'odometer_in_km': 53489,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-11',
     'sanitized_make': 'kia',
     'seller_name': 'zenith',
     'title': 'kia e-niro electric estate 100kw 2 39kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '100kw 2 39kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '6c59c453-d9f6-59ef-b343-5d59ea318a90',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'NL71HSG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117274004',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'KIA',
 'model': 'E-NIRO ELECTRIC ESTATE',
 'odometer': 33237,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-11',
 'seller_name': 'Zenith',
 'title': 'KIA E-NIRO ELECTRIC ESTATE 100kW 2 39kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW 2 39kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117274004%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Saving data for 117274004: {'auction_closing_time': 1764927900.0, 'created_time': 1764184145.265706, 'last_price_update_time': 1764874834.09202}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117274004') HTTP/1.1" 204 0
2025-12-04 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7a829217-3c1c-5d17-b800-6a8f5d857226 with identifier: 117215585
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7a829217-3c1c-5d17-b800-6a8f5d857226 with identifier: 117215585
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 106222 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    106222
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 7a829217-3c1c-5d17-b800-6a8f5d857226 spider: astonbarclay.gb
2025-12-04 19:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7a829217-3c1c-5d17-b800-6a8f5d857226 due to rule: high_mileage_for_make.json, error: 106222 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    106222
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '7a829217-3c1c-5d17-b800-6a8f5d857226',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LG71YOM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117215585',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 66004,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-10',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Standard Plus 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Standard Plus 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215585%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Saving data for 117215585: {'auction_closing_time': 1764927900.0, 'created_time': 1764184184.500485, 'last_price_update_time': 1764874834.300335}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117215585') HTTP/1.1" 204 0
2025-12-04 19:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ae880481-ee45-55c7-b39c-03c28599f30b with identifier: 117180212
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ae880481-ee45-55c7-b39c-03c28599f30b with identifier: 117180212
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 100268 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    100268
2025-12-04 19:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: ae880481-ee45-55c7-b39c-03c28599f30b spider: astonbarclay.gb
2025-12-04 19:00:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ae880481-ee45-55c7-b39c-03c28599f30b due to rule: high_mileage_for_make.json, error: 100268 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    100268
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'ae880481-ee45-55c7-b39c-03c28599f30b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'MJ71YZR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117180212',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 62304,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-15',
 'seller_name': 'Zenith',
 'title': 'TESLA MODEL 3 SALOON Long Range AWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'Long Range AWD 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117180212%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Saving data for 117180212: {'auction_closing_time': 1764927900.0, 'created_time': 1764184223.710547, 'last_price_update_time': 1764874834.515246}
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117180212') HTTP/1.1" 204 0
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117427857
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427857%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117427857: 2
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117316133?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117589537?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 116988307
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Scrape type for 116988307: 2
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117451336
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117451336: 2
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117207172
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117207172: 2
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Found listing with ID: 117386686
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117386686%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Scrape type for 117386686: 2
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117316133, 'registration': 'MH69CYJ', 'account': 'IMG001', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav+ 5dr', 'mileage': 66756, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-05-03', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/d6cf0f1c-6111-446e-af87-8da922b51ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/1fde8c13-fcdb-425b-863f-593dfca59930_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/9239a7c1-fa85-4682-b9f6-0e3d7d6cfe7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/ecbcab43-8e27-41ff-98d8-191388396e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/aac49ebf-542d-4c95-afe3-3945c46abd72_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/d1a70193-7dfd-4cf8-94b9-f03ed2c1ca47_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/5767015b-1730-4146-962a-6a128e0565b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f5f827d3-3bc5-4032-9b19-b9f6d59c8225_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/9eecbf4f-0ced-491f-a9b6-37a25f483a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/0b2eb6bb-20e3-4b5e-865a-2ded3b9c0273_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f44b852f-c25d-4d60-b05e-d412c5281992_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/63623aa5-8642-4441-80f4-65c1af000d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/2620d098-47b6-4e88-88e5-f5f0f07f6c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/7abb23f3-3a84-40af-b952-dd688769bf18_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/c95d2152-65d5-4785-b7f2-aeaa27b2c468_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/4f12a435-259b-47e5-9440-944260e99303_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/344ed0d7-1858-4a27-9868-603084f56a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f57c2d01-fdf8-4936-8462-f1b02ab7f00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/e373a3ce-9b25-4e15-916e-55cfc3163812_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/e058c0c9-d464-4cde-b28e-6b94aae1dad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/788bfc42-1a35-4015-90c0-79359f7dd09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/850f6595-87b4-4179-a5b8-ae808e6377de_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/20-3K, 10/21-7K, 06/22-8K, 04/24-36K, 04/25-53K,', 'remarks': 'VOSA@ 8k, 20k, 36k, 53k SD CARD IN OFFICE', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43cc3253-62c5-435c-b0f8-e1db18290957.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117316133, 'registration': 'MH69CYJ', 'account': 'IMG001', 'make': 'MAZDA', 'model': 'CX-5 ESTATE', 'derivative': '2.0 Sport Nav+ 5dr', 'mileage': 66756, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-09-04', 'fuel': 'Petrol', 'motExpiry': '2026-05-03', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/d6cf0f1c-6111-446e-af87-8da922b51ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/1fde8c13-fcdb-425b-863f-593dfca59930_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/9239a7c1-fa85-4682-b9f6-0e3d7d6cfe7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/ecbcab43-8e27-41ff-98d8-191388396e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/aac49ebf-542d-4c95-afe3-3945c46abd72_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/d1a70193-7dfd-4cf8-94b9-f03ed2c1ca47_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/5767015b-1730-4146-962a-6a128e0565b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f5f827d3-3bc5-4032-9b19-b9f6d59c8225_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/9eecbf4f-0ced-491f-a9b6-37a25f483a44_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/0b2eb6bb-20e3-4b5e-865a-2ded3b9c0273_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f44b852f-c25d-4d60-b05e-d412c5281992_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/63623aa5-8642-4441-80f4-65c1af000d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/2620d098-47b6-4e88-88e5-f5f0f07f6c6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/7abb23f3-3a84-40af-b952-dd688769bf18_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/c95d2152-65d5-4785-b7f2-aeaa27b2c468_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/4f12a435-259b-47e5-9440-944260e99303_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/344ed0d7-1858-4a27-9868-603084f56a3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/f57c2d01-fdf8-4936-8462-f1b02ab7f00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/e373a3ce-9b25-4e15-916e-55cfc3163812_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/e058c0c9-d464-4cde-b28e-6b94aae1dad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/788bfc42-1a35-4015-90c0-79359f7dd09c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MH69CYJ/2025-11-19/image/850f6595-87b4-4179-a5b8-ae808e6377de_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/20-3K, 10/21-7K, 06/22-8K, 04/24-36K, 04/25-53K,', 'remarks': 'VOSA@ 8k, 20k, 36k, 53k SD CARD IN OFFICE', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 145, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43cc3253-62c5-435c-b0f8-e1db18290957.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50f21069-d086-533a-a4b7-92c9c6ef0f61 with identifier: 117316133
2025-12-04 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50f21069-d086-533a-a4b7-92c9c6ef0f61 with scrape type 2
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50f21069-d086-533a-a4b7-92c9c6ef0f61 with scrape type 2
2025-12-04 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 50f21069-d086-533a-a4b7-92c9c6ef0f61, identifier: 117316133
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554544, 'registration': 'MJ22ULD', 'account': 'ARN037', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 28469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/0898a6c9-b3cd-43e5-bb99-907addf76dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/49118846-d8d6-49c6-bebc-19e6b44f465a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/36226f2d-857c-4dff-aa92-2b737c5f0929_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/d11500e2-a39d-46bd-a516-93265fc6ae99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/11654dca-ae07-436b-9b98-0f21b56c53c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/7daf4e88-51cc-4110-b10b-762122110cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9b8012d5-53e0-4d34-96a9-02bb0f38b67d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/0f1a2742-0e4b-4035-8f47-57fa050ebc55_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9af92f8a-5ceb-4a50-bde8-6ca1041d9f3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/862f1c4b-6110-4f37-b92c-9299c76b5d74_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9f41f5b5-0d58-47bb-a736-fb8d8479b40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/36dadb95-4f37-4736-a741-07abbabfed85_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/3b1131ef-5df0-4940-aa57-ce4e0754d6af_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/24-18K, 05/25-26K', 'remarks': 'vosa@ 26k,', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c1100b12-f794-4c22-90a3-ba5090a3455b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554544, 'registration': 'MJ22ULD', 'account': 'ARN037', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 FHEV ST-Line X Edition 5dr CVT', 'mileage': 28469, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-04-29', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-04-28', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/0898a6c9-b3cd-43e5-bb99-907addf76dfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/49118846-d8d6-49c6-bebc-19e6b44f465a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/36226f2d-857c-4dff-aa92-2b737c5f0929_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/d11500e2-a39d-46bd-a516-93265fc6ae99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/11654dca-ae07-436b-9b98-0f21b56c53c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/7daf4e88-51cc-4110-b10b-762122110cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9b8012d5-53e0-4d34-96a9-02bb0f38b67d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/0f1a2742-0e4b-4035-8f47-57fa050ebc55_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9af92f8a-5ceb-4a50-bde8-6ca1041d9f3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/862f1c4b-6110-4f37-b92c-9299c76b5d74_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/9f41f5b5-0d58-47bb-a736-fb8d8479b40c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/36dadb95-4f37-4736-a741-07abbabfed85_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ22ULD/2025-12-02/image/3b1131ef-5df0-4940-aa57-ce4e0754d6af_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/24-18K, 05/25-26K', 'remarks': 'vosa@ 26k,', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c1100b12-f794-4c22-90a3-ba5090a3455b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with identifier: 117554544
2025-12-04 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with scrape type 2
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with scrape type 2
2025-12-04 19:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d, identifier: 117554544
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117589537, 'registration': 'DC23JUO', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23641, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2002, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUO/2025-12-03/image/1324f904-5bb7-4675-972d-910de9a24b97_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/da5291d3-780f-47eb-828b-b474a1dde0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/0dd9b449-2db3-4ca7-adc0-008f8118ed47_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/101203b3-94f1-4ed1-bd10-34739082712d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/8b66d642-4fa9-4056-abf8-caa24270a0ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/a113d383-c821-4938-b7df-71cf383511d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/f6198303-af13-4f5a-95eb-ddfd1f5c62a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/a3ce21be-55b8-4ac4-ae8a-28a8edd0dedc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/eb3fbd74-8cab-49a9-b565-5ff19654b362_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/7e759c3a-df42-4ccb-a7e4-f5892b13082f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/25-18K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26bb3d8d-03fa-43f8-896b-2c526da823f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117589537, 'registration': 'DC23JUO', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23641, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2002, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-26', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUO/2025-12-03/image/1324f904-5bb7-4675-972d-910de9a24b97_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/da5291d3-780f-47eb-828b-b474a1dde0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/0dd9b449-2db3-4ca7-adc0-008f8118ed47_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/101203b3-94f1-4ed1-bd10-34739082712d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/8b66d642-4fa9-4056-abf8-caa24270a0ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/a113d383-c821-4938-b7df-71cf383511d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/f6198303-af13-4f5a-95eb-ddfd1f5c62a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/a3ce21be-55b8-4ac4-ae8a-28a8edd0dedc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/eb3fbd74-8cab-49a9-b565-5ff19654b362_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUO/2025-12-03/image/7e759c3a-df42-4ccb-a7e4-f5892b13082f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/25-18K', 'remarks': '', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/26bb3d8d-03fa-43f8-896b-2c526da823f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58fa07d2-8deb-581a-b5ed-2be07b80330d with identifier: 117589537
2025-12-04 19:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58fa07d2-8deb-581a-b5ed-2be07b80330d with scrape type 2
2025-12-04 19:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58fa07d2-8deb-581a-b5ed-2be07b80330d with scrape type 2
2025-12-04 19:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 58fa07d2-8deb-581a-b5ed-2be07b80330d, identifier: 117589537
2025-12-04 19:00:35 [astonbarclay.gb] INFO: Found listing with ID: 116994676
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [astonbarclay.gb] INFO: Scrape type for 116994676: 2
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252Fa48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 50f21069-d086-533a-a4b7-92c9c6ef0f61 with identifier: 117316133
2025-12-04 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 50f21069-d086-533a-a4b7-92c9c6ef0f61 with identifier: 117316133
2025-12-04 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 50f21069-d086-533a-a4b7-92c9c6ef0f61 with identifier: 117316133 to the API
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2750f21069-d086-533a-a4b7-92c9c6ef0f61%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 50f21069-d086-533a-a4b7-92c9c6ef0f61: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117316133?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '50f21069-d086-533a-a4b7-92c9c6ef0f61',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MH69CYJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117316133',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'MAZDA',
 'model': 'CX-5 ESTATE',
 'odometer': 66756,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-04',
 'seller_name': 'IMG Seat',
 'title': 'MAZDA CX-5 ESTATE 2.0 Sport Nav+ 5dr',
 'transmission': 'manual',
 'trim': '2.0 Sport Nav+ 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316133%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [astonbarclay.gb] INFO: Saving data for 117316133: {'auction_closing_time': 1764939600.0, 'created_time': 1763492561.632084, 'last_price_update_time': 1764874835.344862}
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117316133') HTTP/1.1" 204 0
2025-12-04 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with identifier: 117554544
2025-12-04 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with identifier: 117554544
2025-12-04 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d with identifier: 117554544 to the API
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '6885dd6d-ec4c-5f5c-a2b8-776e7ed6f55d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MJ22ULD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554544',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 28469,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-29',
 'seller_name': 'Arnold Clark',
 'title': 'FORD KUGA ESTATE 2.5 FHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 FHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554544%27 HTTP/1.1" 200 None
2025-12-04 19:00:35 [astonbarclay.gb] INFO: Saving data for 117554544: {'auction_closing_time': 1764939600.0, 'created_time': 1764270313.167349, 'last_price_update_time': 1764874835.720211}
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554544') HTTP/1.1" 204 0
2025-12-04 19:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 58fa07d2-8deb-581a-b5ed-2be07b80330d with identifier: 117589537
2025-12-04 19:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 58fa07d2-8deb-581a-b5ed-2be07b80330d with identifier: 117589537
2025-12-04 19:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 58fa07d2-8deb-581a-b5ed-2be07b80330d with identifier: 117589537 to the API
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2758fa07d2-8deb-581a-b5ed-2be07b80330d%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 58fa07d2-8deb-581a-b5ed-2be07b80330d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117589537?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '58fa07d2-8deb-581a-b5ed-2be07b80330d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JUO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117589537',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 23641,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-26',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117589537%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Saving data for 117589537: {'auction_closing_time': 1765188000.0, 'created_time': 1764666052.2768, 'last_price_update_time': 1764874836.055918}
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117589537') HTTP/1.1" 204 0
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117605302
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605302%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117605302: 2
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252Fba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117522892?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507367?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407792?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117583759
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117583759: 2
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117563502
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117563502: 2
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117189741
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117189741: 2
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117077436
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117077436: 2
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Found listing with ID: 117545534
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Scrape type for 117545534: 2
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117522892, 'registration': 'DC23GHZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19540, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2004, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/b3e38edd-ed78-4b44-8ede-480bbac71e72_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/f9c60789-75c0-431d-9c36-b9aba2fb83c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/89650101-92cd-4179-afc0-7a0570c19673_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/a65e630b-c1ae-4640-a7da-75db4b98b595_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/a5eeb7f8-b99e-4206-8af2-93a8d68b64a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/c7ee4244-e84d-45dc-a209-518f43f3def7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/fdae51dd-6c35-4c85-89bc-ba9739f1189a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/e826268f-2066-4f49-934c-65994cbc08e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/242bb4e4-b0bc-4add-8ff7-b7c909277968_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/abe5946a-80ae-4c08-9e13-059bbeadcc45_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25-16K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cde9e6d0-741c-49f8-8266-3fb879e30f13.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117522892, 'registration': 'DC23GHZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19540, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2004, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/b3e38edd-ed78-4b44-8ede-480bbac71e72_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/f9c60789-75c0-431d-9c36-b9aba2fb83c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/89650101-92cd-4179-afc0-7a0570c19673_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/a65e630b-c1ae-4640-a7da-75db4b98b595_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/a5eeb7f8-b99e-4206-8af2-93a8d68b64a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/c7ee4244-e84d-45dc-a209-518f43f3def7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/fdae51dd-6c35-4c85-89bc-ba9739f1189a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/e826268f-2066-4f49-934c-65994cbc08e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/242bb4e4-b0bc-4add-8ff7-b7c909277968_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23GHZ/2025-11-28/image/abe5946a-80ae-4c08-9e13-059bbeadcc45_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/25-16K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cde9e6d0-741c-49f8-8266-3fb879e30f13.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ad1966-72cb-552a-b0ca-cb276699adde with identifier: 117522892
2025-12-04 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ad1966-72cb-552a-b0ca-cb276699adde with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ad1966-72cb-552a-b0ca-cb276699adde with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b7ad1966-72cb-552a-b0ca-cb276699adde, identifier: 117522892
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507367, 'registration': 'DF23XVA', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19789, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2003, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23XVA/2025-11-28/image/9c4b221f-a674-4d6b-b2d2-d626cdc25400_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/7d7506c2-eb45-4565-b777-f3e2abc07454_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/22c77f8f-2bb9-4bac-8d11-508e605f14c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/8b26ac5b-6aa3-40bf-96ae-5cb2663496be_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/9eaea24e-b0e6-4280-a2dc-8fb55b76c917_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/07365500-d12f-4a2e-a431-cc8052ed562a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/3e0eb5fc-2664-49eb-808d-d8e2c025b382_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/0d96b08f-e04f-48b7-995d-2085b6cfb7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/fd863ec7-768c-42f3-bd88-a2b29ad0b532_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25-15K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4c972192-4ea1-4cb7-a507-30b2da56bff5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507367, 'registration': 'DF23XVA', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 19789, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2003, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23XVA/2025-11-28/image/9c4b221f-a674-4d6b-b2d2-d626cdc25400_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/7d7506c2-eb45-4565-b777-f3e2abc07454_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/22c77f8f-2bb9-4bac-8d11-508e605f14c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/8b26ac5b-6aa3-40bf-96ae-5cb2663496be_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/9eaea24e-b0e6-4280-a2dc-8fb55b76c917_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/07365500-d12f-4a2e-a431-cc8052ed562a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/3e0eb5fc-2664-49eb-808d-d8e2c025b382_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/0d96b08f-e04f-48b7-995d-2085b6cfb7fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23XVA/2025-11-28/image/fd863ec7-768c-42f3-bd88-a2b29ad0b532_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25-15K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4c972192-4ea1-4cb7-a507-30b2da56bff5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 462d4f8a-c21d-5e14-938d-546b10e35686 with identifier: 117507367
2025-12-04 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 462d4f8a-c21d-5e14-938d-546b10e35686 with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 462d4f8a-c21d-5e14-938d-546b10e35686 with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 462d4f8a-c21d-5e14-938d-546b10e35686, identifier: 117507367
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407792, 'registration': 'WR19GLK', 'account': 'ARN088', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 91713, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR19GLK/2025-11-25/image/c37fa522-20a8-4161-b11b-7d1eff7ba1dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/a0190d04-31c7-4f6e-8c75-59ca4b42f051_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/3f0a9cbc-5329-45e5-8469-8213daf6bb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/95a0a330-3326-4b1f-85a2-6d0da6381110_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/667dda8f-7fcf-4756-9d06-930473a10f72_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/93a18b2f-9fb3-4efa-a82f-a5752adbf198_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/73e7b945-149c-437d-959b-3dccf079bb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/88703927-22c4-4f1f-9132-66340abc0b95_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/c24a4b91-015e-483d-bb09-fc6f8d244895_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/27cdfb33-146b-4f6a-bb7e-2b96f696a75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/62cb1323-8189-4d40-8013-9c547a52fd2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/69486008-ce27-42b3-b610-927b4529a9ad_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/23- 48k, 06/24- 70k', 'remarks': 'vosa@ 34k, 48k, 64k, 80k spare key', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e634d82-e0b2-415a-8a25-2636c2459bf4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407792, 'registration': 'WR19GLK', 'account': 'ARN088', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 91713, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR19GLK/2025-11-25/image/c37fa522-20a8-4161-b11b-7d1eff7ba1dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/a0190d04-31c7-4f6e-8c75-59ca4b42f051_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/3f0a9cbc-5329-45e5-8469-8213daf6bb76_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/95a0a330-3326-4b1f-85a2-6d0da6381110_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/667dda8f-7fcf-4756-9d06-930473a10f72_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/93a18b2f-9fb3-4efa-a82f-a5752adbf198_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/73e7b945-149c-437d-959b-3dccf079bb09_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/88703927-22c4-4f1f-9132-66340abc0b95_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/c24a4b91-015e-483d-bb09-fc6f8d244895_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/27cdfb33-146b-4f6a-bb7e-2b96f696a75f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/62cb1323-8189-4d40-8013-9c547a52fd2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR19GLK/2025-11-25/image/69486008-ce27-42b3-b610-927b4529a9ad_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/23- 48k, 06/24- 70k', 'remarks': 'vosa@ 34k, 48k, 64k, 80k spare key', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3e634d82-e0b2-415a-8a25-2636c2459bf4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bed6858-b5e1-5975-a255-f7ef84bfb162 with identifier: 117407792
2025-12-04 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bed6858-b5e1-5975-a255-f7ef84bfb162 with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bed6858-b5e1-5975-a255-f7ef84bfb162 with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4bed6858-b5e1-5975-a255-f7ef84bfb162, identifier: 117407792
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554753, 'registration': 'BV68OMR', 'account': 'ARN185', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '40 TDI Sport 4dr S Tronic', 'mileage': 105112, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-02', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BV68OMR/2025-12-02/image/e1b7ae2a-32e2-4e20-a964-cb21353c50a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/eb1839d2-c9b0-4782-873e-8fd7739c8a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/98fd07d6-941c-4db9-a84e-b2021cd3da99_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/7ae79db1-afe1-4ff4-b7ce-a6c739baf5ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/0e150b42-5e5e-408b-bbb7-3a4d75e2dc2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/041319dc-b3e9-43c1-bcc8-2efe8944e3b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/5ecfdc57-e1ef-4731-bde0-8d95ac246e6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/5276fa3c-8943-4cdc-86d7-b22ff41f8cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/1300b326-604b-41f6-9f69-369db69c3263_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/a2f6b92c-3dd8-4c0f-a181-b7f845a9def2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/f5366c76-2821-4246-bce9-005276b8659b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/13e811f5-d9ef-4040-94c3-3c722526fa4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/8cbcb201-a89d-4bfd-9519-3b1c6cd37d9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/a1b32160-82b0-40b9-af32-3de0989ba144_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/7416dfcf-6d63-4fcd-81b3-5336d0d5ea23_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/503f33af-1eab-4e95-8ae5-229190ee3820_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/f691924b-4c03-4f2a-95d3-0421deb9f71a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/80937e3f-413e-4910-b240-71884214ff6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/d1cab4e0-c5cb-4399-8e40-f51e27e7cd3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/08be7ac3-f9f6-4f3f-a5b1-4b3addc0752d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/38ea33f2-9f93-4bc4-8cad-a10ad6b4e4ad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/20-17k 08/22-46k 07/23-63k 11/24-90k', 'remarks': 'vosa@ 25k, 47k, 65k, 86k, 102k, spare key in office', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4da8aded-ac75-4e63-8c51-e35a349a1ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554753, 'registration': 'BV68OMR', 'account': 'ARN185', 'make': 'AUDI', 'model': 'A6 DIESEL SALOON', 'derivative': '40 TDI Sport 4dr S Tronic', 'mileage': 105112, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-24', 'fuel': 'Diesel', 'motExpiry': '2026-09-02', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/BV68OMR/2025-12-02/image/e1b7ae2a-32e2-4e20-a964-cb21353c50a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/eb1839d2-c9b0-4782-873e-8fd7739c8a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/98fd07d6-941c-4db9-a84e-b2021cd3da99_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/7ae79db1-afe1-4ff4-b7ce-a6c739baf5ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/0e150b42-5e5e-408b-bbb7-3a4d75e2dc2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/041319dc-b3e9-43c1-bcc8-2efe8944e3b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/5ecfdc57-e1ef-4731-bde0-8d95ac246e6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/5276fa3c-8943-4cdc-86d7-b22ff41f8cd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/1300b326-604b-41f6-9f69-369db69c3263_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/a2f6b92c-3dd8-4c0f-a181-b7f845a9def2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/f5366c76-2821-4246-bce9-005276b8659b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/13e811f5-d9ef-4040-94c3-3c722526fa4e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/8cbcb201-a89d-4bfd-9519-3b1c6cd37d9f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/a1b32160-82b0-40b9-af32-3de0989ba144_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/7416dfcf-6d63-4fcd-81b3-5336d0d5ea23_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/503f33af-1eab-4e95-8ae5-229190ee3820_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/f691924b-4c03-4f2a-95d3-0421deb9f71a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/80937e3f-413e-4910-b240-71884214ff6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/d1cab4e0-c5cb-4399-8e40-f51e27e7cd3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/08be7ac3-f9f6-4f3f-a5b1-4b3addc0752d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BV68OMR/2025-12-02/image/38ea33f2-9f93-4bc4-8cad-a10ad6b4e4ad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/20-17k 08/22-46k 07/23-63k 11/24-90k', 'remarks': 'vosa@ 25k, 47k, 65k, 86k, 102k, spare key in office', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4da8aded-ac75-4e63-8c51-e35a349a1ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d12bd6b-130a-5315-95da-088539af384d with identifier: 117554753
2025-12-04 19:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d12bd6b-130a-5315-95da-088539af384d with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d12bd6b-130a-5315-95da-088539af384d with scrape type 2
2025-12-04 19:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d12bd6b-130a-5315-95da-088539af384d, identifier: 117554753
2025-12-04 19:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b7ad1966-72cb-552a-b0ca-cb276699adde with identifier: 117522892
2025-12-04 19:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b7ad1966-72cb-552a-b0ca-cb276699adde with identifier: 117522892
2025-12-04 19:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b7ad1966-72cb-552a-b0ca-cb276699adde with identifier: 117522892 to the API
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b7ad1966-72cb-552a-b0ca-cb276699adde%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b7ad1966-72cb-552a-b0ca-cb276699adde: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117522892?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b7ad1966-72cb-552a-b0ca-cb276699adde',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23GHZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117522892',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 19540,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117522892%27 HTTP/1.1" 200 None
2025-12-04 19:00:36 [astonbarclay.gb] INFO: Saving data for 117522892: {'auction_closing_time': 1765188000.0, 'created_time': 1764320471.31988, 'last_price_update_time': 1764874836.962477}
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117522892') HTTP/1.1" 204 0
2025-12-04 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 462d4f8a-c21d-5e14-938d-546b10e35686 with identifier: 117507367
2025-12-04 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 462d4f8a-c21d-5e14-938d-546b10e35686 with identifier: 117507367
2025-12-04 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 462d4f8a-c21d-5e14-938d-546b10e35686 with identifier: 117507367 to the API
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27462d4f8a-c21d-5e14-938d-546b10e35686%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 462d4f8a-c21d-5e14-938d-546b10e35686: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507367?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '462d4f8a-c21d-5e14-938d-546b10e35686',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23XVA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507367',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 19789,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507367%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Saving data for 117507367: {'auction_closing_time': 1765188000.0, 'created_time': 1764320470.346521, 'last_price_update_time': 1764874837.336152}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507367') HTTP/1.1" 204 0
2025-12-04 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4bed6858-b5e1-5975-a255-f7ef84bfb162 with identifier: 117407792
2025-12-04 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4bed6858-b5e1-5975-a255-f7ef84bfb162 with identifier: 117407792
2025-12-04 19:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4bed6858-b5e1-5975-a255-f7ef84bfb162 with identifier: 117407792 to the API
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274bed6858-b5e1-5975-a255-f7ef84bfb162%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4bed6858-b5e1-5975-a255-f7ef84bfb162: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117407792?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4bed6858-b5e1-5975-a255-f7ef84bfb162',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR19GLK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407792',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 91713,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407792%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Saving data for 117407792: {'auction_closing_time': 1764939600.0, 'created_time': 1763751813.015315, 'last_price_update_time': 1764874837.650375}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407792') HTTP/1.1" 204 0
2025-12-04 19:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d12bd6b-130a-5315-95da-088539af384d with identifier: 117554753
2025-12-04 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d12bd6b-130a-5315-95da-088539af384d with identifier: 117554753
2025-12-04 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 169160 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169160
2025-12-04 19:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0d12bd6b-130a-5315-95da-088539af384d spider: astonbarclay.gb
2025-12-04 19:00:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0d12bd6b-130a-5315-95da-088539af384d due to rule: high_mileage_for_country.json, error: 169160 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    169160
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '0d12bd6b-130a-5315-95da-088539af384d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV68OMR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554753',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'AUDI',
 'model': 'A6 DIESEL SALOON',
 'odometer': 105112,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-24',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'AUDI A6 DIESEL SALOON 40 TDI Sport 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Sport 4dr S Tronic',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554753%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Saving data for 117554753: {'auction_closing_time': 1764939600.0, 'created_time': 1764270235.758053, 'last_price_update_time': 1764874837.866896}
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554753') HTTP/1.1" 204 0
2025-12-04 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117576078
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117576078: 2
2025-12-04 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117584754?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507387?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117045093
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117045093%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117045093: 0
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117207188
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117207188: 2
2025-12-04 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517722?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117605293
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605293%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117605293: 2
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117399593
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399593%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117399593: 0
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117474004
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117474004%27 HTTP/1.1" 200 None
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Scrape type for 117474004: 0
2025-12-04 19:00:37 [astonbarclay.gb] INFO: Found listing with ID: 117422977
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422977%27 HTTP/1.1" 200 None
2025-12-04 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117422977: 2
2025-12-04 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 115422003
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115422003%27 HTTP/1.1" 200 None
2025-12-04 19:00:38 [astonbarclay.gb] INFO: Scrape type for 115422003: 0
2025-12-04 19:00:38 [astonbarclay.gb] INFO: Found listing with ID: 117376148
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-12-04 19:00:38 [astonbarclay.gb] INFO: Scrape type for 117376148: 2
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a88f50>
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59a3990>
2025-12-04 19:00:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117584754, 'registration': 'HG72WBT', 'account': 'DAY005', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '35 TFSI Technik 4dr S Tronic', 'mileage': 33938, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2016, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1984, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HG72WBT/2025-12-02/image/7ff9c510-e925-4106-b481-5f69370e3bb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/7acb32ef-5e58-4baa-b0bf-a658a8ce8ce5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/2b42b9fb-7c79-4b10-a493-466d29d33d3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/91741f39-5879-4106-a13f-eb01c36f16ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/d1481e7c-e726-418d-8d82-9723f908053c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/c7f1a398-a39e-4e5f-bbf0-685d11135a9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/976962fe-533b-49af-9401-c7e4f8f50618_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/de0cb3e4-f532-44db-92d5-2aa90a7b3acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/e121498a-f574-4afb-a28f-c418271d3236_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/f5f1bd40-db0f-444d-86fb-26849805565e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f99228b-fee7-4c2b-89ca-f93ff105c7c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117584754, 'registration': 'HG72WBT', 'account': 'DAY005', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '35 TFSI Technik 4dr S Tronic', 'mileage': 33938, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2016, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-01-16', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 4, 'engineSize': 1984, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/HG72WBT/2025-12-02/image/7ff9c510-e925-4106-b481-5f69370e3bb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/7acb32ef-5e58-4baa-b0bf-a658a8ce8ce5_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/2b42b9fb-7c79-4b10-a493-466d29d33d3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/91741f39-5879-4106-a13f-eb01c36f16ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/d1481e7c-e726-418d-8d82-9723f908053c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/c7f1a398-a39e-4e5f-bbf0-685d11135a9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/976962fe-533b-49af-9401-c7e4f8f50618_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/de0cb3e4-f532-44db-92d5-2aa90a7b3acd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/e121498a-f574-4afb-a28f-c418271d3236_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG72WBT/2025-12-02/image/f5f1bd40-db0f-444d-86fb-26849805565e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Days Fleet', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f99228b-fee7-4c2b-89ca-f93ff105c7c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with identifier: 117584754
2025-12-04 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with scrape type 2
2025-12-04 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with scrape type 2
2025-12-04 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c0ffc0a-3b13-5b55-8825-c37f57c418f9, identifier: 117584754
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507387, 'registration': 'DC23BVH', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17555, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2010, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23BVH/2025-11-28/image/bf9bcec8-afd3-4645-ba80-a67bf6511a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/1e527f66-2c5f-4319-b04a-118490ce39d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/58b2c090-9a83-4a44-8aa2-03f3b52a3549_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/6acbfca2-900d-41c4-99bf-061dca8bcf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/dd97cd1a-b44a-4560-bc18-99940dd9ebf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/6ba6741f-4a19-4c60-9c98-816ed5ce5a20_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/86d0b45a-7022-42cd-bba3-a7944a65a6f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/bd84f449-508b-48ec-9d75-6b615bbd3da9_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25-14K', 'remarks': 'NO V5, UNKNOWN AMOUNT OF OWNERS, NO MOT HISTORY, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c499064c-61b6-42a4-b89e-699cd7b5b8a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507387, 'registration': 'DC23BVH', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 17555, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2010, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-25', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23BVH/2025-11-28/image/bf9bcec8-afd3-4645-ba80-a67bf6511a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/1e527f66-2c5f-4319-b04a-118490ce39d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/58b2c090-9a83-4a44-8aa2-03f3b52a3549_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/6acbfca2-900d-41c4-99bf-061dca8bcf8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/dd97cd1a-b44a-4560-bc18-99940dd9ebf0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/6ba6741f-4a19-4c60-9c98-816ed5ce5a20_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/86d0b45a-7022-42cd-bba3-a7944a65a6f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23BVH/2025-11-28/image/bd84f449-508b-48ec-9d75-6b615bbd3da9_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25-14K', 'remarks': 'NO V5, UNKNOWN AMOUNT OF OWNERS, NO MOT HISTORY, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c499064c-61b6-42a4-b89e-699cd7b5b8a0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c993635e-5ebe-5790-8660-486cb1c0809c with identifier: 117507387
2025-12-04 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c993635e-5ebe-5790-8660-486cb1c0809c with scrape type 2
2025-12-04 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c993635e-5ebe-5790-8660-486cb1c0809c with scrape type 2
2025-12-04 19:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c993635e-5ebe-5790-8660-486cb1c0809c, identifier: 117507387
2025-12-04 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Found listing with ID: 117631646
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631646%27 HTTP/1.1" 200 None
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Scrape type for 117631646: 2
2025-12-04 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with identifier: 117584754
2025-12-04 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with identifier: 117584754
2025-12-04 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9c0ffc0a-3b13-5b55-8825-c37f57c418f9 with identifier: 117584754 to the API
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279c0ffc0a-3b13-5b55-8825-c37f57c418f9%27 HTTP/1.1" 200 None
2025-12-04 19:00:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9c0ffc0a-3b13-5b55-8825-c37f57c418f9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117584754?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9c0ffc0a-3b13-5b55-8825-c37f57c418f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HG72WBT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117584754',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A4 SALOON',
 'odometer': 33938,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-01-16',
 'seller_name': 'Days Fleet',
 'title': 'AUDI A4 SALOON 35 TFSI Technik 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TFSI Technik 4dr S Tronic',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584754%27 HTTP/1.1" 200 None
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Saving data for 117584754: {'auction_closing_time': 1765188000.0, 'created_time': 1764666051.555603, 'last_price_update_time': 1764874839.644168}
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117584754') HTTP/1.1" 204 0
2025-12-04 19:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c993635e-5ebe-5790-8660-486cb1c0809c with identifier: 117507387
2025-12-04 19:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c993635e-5ebe-5790-8660-486cb1c0809c with identifier: 117507387
2025-12-04 19:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c993635e-5ebe-5790-8660-486cb1c0809c with identifier: 117507387 to the API
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c993635e-5ebe-5790-8660-486cb1c0809c%27 HTTP/1.1" 200 None
2025-12-04 19:00:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c993635e-5ebe-5790-8660-486cb1c0809c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507387?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c993635e-5ebe-5790-8660-486cb1c0809c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23BVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507387',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 17555,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-25',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507387%27 HTTP/1.1" 200 None
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Saving data for 117507387: {'auction_closing_time': 1765188000.0, 'created_time': 1764320469.174978, 'last_price_update_time': 1764874839.938843}
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507387') HTTP/1.1" 204 0
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517722, 'registration': 'YR69EFF', 'account': 'ARN163', 'make': 'VOLVO', 'model': 'XC90 ESTATE', 'derivative': '2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron', 'mileage': 72293, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-12', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-23', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR69EFF/2025-11-28/image/58d6295c-eb8d-44f6-bd02-3eb4d2e18e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/d7e917d3-7eb7-4833-9662-3497f08e4079_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/e970fb97-fa06-4b8c-9d54-5ce4cd21e3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/616c6a33-67af-46fc-beed-64696f2c8e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/deaac053-2f66-447b-abea-b9e32fc26336_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/512c3314-439b-499d-ad9a-21acff98ddb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/b190230a-8d86-4bb9-ab63-dae7e2d054b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/5df079b1-30ce-47d8-a44a-b72dcd4f6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/127e6aff-fb0c-4f18-9d9d-9a200097205b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/abe33a97-acfc-400c-a38f-f6fff39e1e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/bd4af908-ac1f-4c6b-88de-4b5a4c2d5ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/5c4a61ab-ea84-4541-bc76-4d5a0609b549_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-13K, 08/21-23K, 08/22-37K 04/23-39k 04/25-69k', 'remarks': 'vosa@ 38k, 39k, 53k, 69k SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 52, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82061a55-6c5f-4974-b97e-891481c186dd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517722, 'registration': 'YR69EFF', 'account': 'ARN163', 'make': 'VOLVO', 'model': 'XC90 ESTATE', 'derivative': '2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron', 'mileage': 72293, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-12', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-23', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR69EFF/2025-11-28/image/58d6295c-eb8d-44f6-bd02-3eb4d2e18e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/d7e917d3-7eb7-4833-9662-3497f08e4079_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/e970fb97-fa06-4b8c-9d54-5ce4cd21e3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/616c6a33-67af-46fc-beed-64696f2c8e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/deaac053-2f66-447b-abea-b9e32fc26336_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/512c3314-439b-499d-ad9a-21acff98ddb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/b190230a-8d86-4bb9-ab63-dae7e2d054b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/5df079b1-30ce-47d8-a44a-b72dcd4f6dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/127e6aff-fb0c-4f18-9d9d-9a200097205b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/abe33a97-acfc-400c-a38f-f6fff39e1e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/bd4af908-ac1f-4c6b-88de-4b5a4c2d5ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69EFF/2025-11-28/image/5c4a61ab-ea84-4541-bc76-4d5a0609b549_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-13K, 08/21-23K, 08/22-37K 04/23-39k 04/25-69k', 'remarks': 'vosa@ 38k, 39k, 53k, 69k SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 52, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/82061a55-6c5f-4974-b97e-891481c186dd.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e91e7f7e-1df9-5d46-bf3f-0059297c37dd with identifier: 117517722
2025-12-04 19:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e91e7f7e-1df9-5d46-bf3f-0059297c37dd with scrape type 2
2025-12-04 19:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e91e7f7e-1df9-5d46-bf3f-0059297c37dd with scrape type 2
2025-12-04 19:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e91e7f7e-1df9-5d46-bf3f-0059297c37dd, identifier: 117517722
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117459934
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117459934: 2
2025-12-04 19:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e91e7f7e-1df9-5d46-bf3f-0059297c37dd with identifier: 117517722
2025-12-04 19:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e91e7f7e-1df9-5d46-bf3f-0059297c37dd with identifier: 117517722
2025-12-04 19:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e91e7f7e-1df9-5d46-bf3f-0059297c37dd with identifier: 117517722 to the API
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e91e7f7e-1df9-5d46-bf3f-0059297c37dd%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e91e7f7e-1df9-5d46-bf3f-0059297c37dd: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117517722?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 52,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'e91e7f7e-1df9-5d46-bf3f-0059297c37dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR69EFF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517722',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VOLVO',
 'model': 'XC90 ESTATE',
 'odometer': 72293,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-12',
 'seller_name': 'Arnold Clark',
 'title': 'VOLVO XC90 ESTATE 2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron',
 'transmission': 'automatic',
 'trim': '2.0 T8 [390] Hybrid Inscription 5dr AWD Gtron',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517722%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Saving data for 117517722: {'auction_closing_time': 1764939600.0, 'created_time': 1764184281.577023, 'last_price_update_time': 1764874840.346533}
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517722') HTTP/1.1" 204 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117666471
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666471%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117666471: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117681164
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681164%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117681164: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117639372
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639372%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117639372: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117638370
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638370%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117638370: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117680503
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117680503%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117680503: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117704526
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704526%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117704526: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117704752
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704752%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117704752: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117572803
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117572803%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117572803: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117639666
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639666%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117639666: 0
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Found listing with ID: 117614020
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614020%27 HTTP/1.1" 200 None
2025-12-04 19:00:40 [astonbarclay.gb] INFO: Scrape type for 117614020: 2
2025-12-04 19:00:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6b35490>
2025-12-04 19:00:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252Fba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b669d0>
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252Fa48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615455
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615455%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615455: 2
2025-12-04 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117061252?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117489691?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117366956?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117420392?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615786
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615786%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615786: 2
2025-12-04 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117615634
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615634%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117615634: 2
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117735489
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735489%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117735489: 1
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117735065
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735065%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117735065: 0
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117741310
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741310%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117741310: 0
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117269087
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269087%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117269087: 0
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117272082
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272082%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117272082: 0
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117634969
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634969%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117634969: 0
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117763847
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763847%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117763847: 1
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662832, 'registration': 'PL66FPO', 'account': 'STA058', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] SE 5dr [Nav]', 'mileage': 106630, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2028, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-07', 'fuel': 'Petrol', 'motExpiry': '2025-01-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9136b93a-ab98-468c-885c-ecdaa89d7fdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662832, 'registration': 'PL66FPO', 'account': 'STA058', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] SE 5dr [Nav]', 'mileage': 106630, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2028, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-12-07', 'fuel': 'Petrol', 'motExpiry': '2025-01-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9136b93a-ab98-468c-885c-ecdaa89d7fdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a868bd6-ed54-55cd-a025-9e926c1ca822 with identifier: 117662832
2025-12-04 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a868bd6-ed54-55cd-a025-9e926c1ca822 with scrape type 1
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Found listing with ID: 117763614
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763614%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Scrape type for 117763614: 1
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117061252, 'registration': 'ET66KNY', 'account': 'MAN027', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Pop Star 3dr', 'mileage': 64186, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2034, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET66KNY/2025-11-10/image/c54bd32f-597e-4de4-ad59-c4f284b0516f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/75e72c12-b583-47a8-96b7-fd19736c33c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/dd5c43ec-725e-4894-8b33-dc03616c5a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/a6461a19-3e76-4437-95dd-97cbe0e7f59a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/06b6e221-3d06-4b1e-8ef1-2ef1397d22bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/fe3ca72e-220f-4293-90f3-56fa06f36d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/0adf8733-7a2f-4ca4-bd9c-57d892aa7b4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/25a3600b-bd34-4391-9689-179d2bf5cdfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/c1afb8b6-fd6a-418f-bb07-95530e6049e3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/21- 30K, 01/22- 38K, 01/23- 46K, 11/23- 49K, 10/24- 58K', 'remarks': 'VOSA STATES 38K, 46K, 49K, 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4b821ca-9b37-47c7-9fe6-67fff643625d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117061252, 'registration': 'ET66KNY', 'account': 'MAN027', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Pop Star 3dr', 'mileage': 64186, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2034, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-01-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET66KNY/2025-11-10/image/c54bd32f-597e-4de4-ad59-c4f284b0516f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/75e72c12-b583-47a8-96b7-fd19736c33c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/dd5c43ec-725e-4894-8b33-dc03616c5a89_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/a6461a19-3e76-4437-95dd-97cbe0e7f59a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/06b6e221-3d06-4b1e-8ef1-2ef1397d22bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/fe3ca72e-220f-4293-90f3-56fa06f36d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/0adf8733-7a2f-4ca4-bd9c-57d892aa7b4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/25a3600b-bd34-4391-9689-179d2bf5cdfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET66KNY/2025-11-10/image/c1afb8b6-fd6a-418f-bb07-95530e6049e3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 01/21- 30K, 01/22- 38K, 01/23- 46K, 11/23- 49K, 10/24- 58K', 'remarks': 'VOSA STATES 38K, 46K, 49K, 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4b821ca-9b37-47c7-9fe6-67fff643625d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d9bff29-fc6f-566f-847f-5a24bf78479e with identifier: 117061252
2025-12-04 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d9bff29-fc6f-566f-847f-5a24bf78479e with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d9bff29-fc6f-566f-847f-5a24bf78479e with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6d9bff29-fc6f-566f-847f-5a24bf78479e, identifier: 117061252
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117489691, 'registration': 'MJ17DZB', 'account': 'MAN027', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 82 Flair 5dr', 'mileage': 54609, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2037, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-19', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/cfd6976e-7fa9-44b7-ba1e-b0c74a4fef85_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/f2dc10bb-e311-4d28-b864-ca0d5a43ea06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/4ee4f2a8-2c3e-424f-8048-653c0de04bae_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/55f8e79e-a81d-4f68-b8ef-5cd7bffd8682_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/556301b0-ca2e-45ea-8f3d-a4f5f7a061d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/8443bb19-a7c7-49e7-9cca-a251a5d4a283_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/3a14b535-3594-4e03-b3df-5ef51cf3e6aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/74809021-721e-48ef-99c2-02a269400251_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/8e048711-408c-4f28-8b1f-613c38bfef9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/6ba9c42d-5df1-4718-94c3-84a25d436ac4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-8K 06/19-23K 08/21-41K 11/22-45K 10/24-50K 11/25-54K', 'remarks': 'SPARE KEY IN OFFICE, VOSA  STATES 45K 48K 50K 54K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60c00b95-9a3d-43f4-ad14-0025eeebf93c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117489691, 'registration': 'MJ17DZB', 'account': 'MAN027', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 82 Flair 5dr', 'mileage': 54609, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2037, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-19', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/cfd6976e-7fa9-44b7-ba1e-b0c74a4fef85_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/f2dc10bb-e311-4d28-b864-ca0d5a43ea06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/4ee4f2a8-2c3e-424f-8048-653c0de04bae_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/55f8e79e-a81d-4f68-b8ef-5cd7bffd8682_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/556301b0-ca2e-45ea-8f3d-a4f5f7a061d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/8443bb19-a7c7-49e7-9cca-a251a5d4a283_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/3a14b535-3594-4e03-b3df-5ef51cf3e6aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/74809021-721e-48ef-99c2-02a269400251_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/8e048711-408c-4f28-8b1f-613c38bfef9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MJ17DZB/2025-11-26/image/6ba9c42d-5df1-4718-94c3-84a25d436ac4_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18-8K 06/19-23K 08/21-41K 11/22-45K 10/24-50K 11/25-54K', 'remarks': 'SPARE KEY IN OFFICE, VOSA  STATES 45K 48K 50K 54K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 109, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60c00b95-9a3d-43f4-ad14-0025eeebf93c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with identifier: 117489691
2025-12-04 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec3f6c10-6e45-5187-b98a-6bc3b9f30cef, identifier: 117489691
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117366956, 'registration': 'YE69DWG', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 Urban Edition 5dr Auto', 'mileage': 48364, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2035, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE69DWG/2025-11-20/image/277bfaf5-3de9-4fe7-b983-3ac544900548_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/c6909d51-42ef-42c6-804b-1759808765cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/67f8b0e9-9e3d-4c1b-8060-f80fe3d1a27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/89727222-593b-4c3d-85b2-6ac0f2c4393d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/32d70b9c-fe65-4f31-8f5b-c1251e5d451b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/c4c80aae-b8d1-4d45-b95b-20b362369534_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/344d13a8-3f66-440e-90db-c851c90d460d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/7df31722-0b17-445b-b533-67ed213fa5e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/34b37bed-7fd3-494a-90a2-1da643edcbef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/5affeedf-3b2a-4b6e-8bf0-6ca764387352_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/20-17K 10/24-39K 11/25-48K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 31K 39K 47K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4927e170-6229-444f-86e1-a1a923354587.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117366956, 'registration': 'YE69DWG', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 180 Urban Edition 5dr Auto', 'mileage': 48364, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2035, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-10-25', 'fuel': 'Petrol', 'motExpiry': '2026-10-25', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YE69DWG/2025-11-20/image/277bfaf5-3de9-4fe7-b983-3ac544900548_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/c6909d51-42ef-42c6-804b-1759808765cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/67f8b0e9-9e3d-4c1b-8060-f80fe3d1a27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/89727222-593b-4c3d-85b2-6ac0f2c4393d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/32d70b9c-fe65-4f31-8f5b-c1251e5d451b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/c4c80aae-b8d1-4d45-b95b-20b362369534_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/344d13a8-3f66-440e-90db-c851c90d460d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/7df31722-0b17-445b-b533-67ed213fa5e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/34b37bed-7fd3-494a-90a2-1da643edcbef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE69DWG/2025-11-20/image/5affeedf-3b2a-4b6e-8bf0-6ca764387352_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 11/20-17K 10/24-39K 11/25-48K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 31K 39K 47K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4927e170-6229-444f-86e1-a1a923354587.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6575e71f-0d7c-5883-a249-b9e7adb3895d with identifier: 117366956
2025-12-04 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6575e71f-0d7c-5883-a249-b9e7adb3895d with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6575e71f-0d7c-5883-a249-b9e7adb3895d with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6575e71f-0d7c-5883-a249-b9e7adb3895d, identifier: 117366956
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117420392, 'registration': 'BT69VCE', 'account': 'MAN027', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '35 TDI Sport 5dr S Tronic', 'mileage': 67169, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2038, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-11-27', 'fuel': 'Diesel', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT69VCE/2025-11-21/image/125a206c-ace9-4ba6-8a09-c02c8b0467b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/e56df504-1c48-4039-912d-81999868a6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/b2ab05f4-84c4-422a-a546-1cd67467521e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/eedea2fa-8638-402d-9e7f-5f5cdce27e9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/8fe2c9f4-d48f-4639-a3a1-c8523bc9a53f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/99a7a0e5-0557-48d8-8a13-29c31a3508f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/639bd47b-e62d-48e8-92c6-b7d9241b9d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/3b712c20-61f9-4435-b06c-917b7f59b871_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/61fb0bf2-6066-43a2-b25b-9b9a8731929e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 35K 51K 62K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d99494a4-a4eb-4fac-82c2-b26131bb9bcc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117420392, 'registration': 'BT69VCE', 'account': 'MAN027', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '35 TDI Sport 5dr S Tronic', 'mileage': 67169, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2038, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-11-27', 'fuel': 'Diesel', 'motExpiry': '2026-03-26', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BT69VCE/2025-11-21/image/125a206c-ace9-4ba6-8a09-c02c8b0467b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/e56df504-1c48-4039-912d-81999868a6dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/b2ab05f4-84c4-422a-a546-1cd67467521e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/eedea2fa-8638-402d-9e7f-5f5cdce27e9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/8fe2c9f4-d48f-4639-a3a1-c8523bc9a53f_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/99a7a0e5-0557-48d8-8a13-29c31a3508f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/639bd47b-e62d-48e8-92c6-b7d9241b9d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/3b712c20-61f9-4435-b06c-917b7f59b871_removebg.jpg?w=600', 'https://abimg003.imgix.net/BT69VCE/2025-11-21/image/61fb0bf2-6066-43a2-b25b-9b9a8731929e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 35K 51K 62K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d99494a4-a4eb-4fac-82c2-b26131bb9bcc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6d689cf-3953-5e33-a25d-f97bc38a3588 with identifier: 117420392
2025-12-04 19:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6d689cf-3953-5e33-a25d-f97bc38a3588 with scrape type 2
2025-12-04 19:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6d689cf-3953-5e33-a25d-f97bc38a3588 with scrape type 2
2025-12-04 19:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e6d689cf-3953-5e33-a25d-f97bc38a3588, identifier: 117420392
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117505585
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117505585%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117505585: 0
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117708032
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708032%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117708032: 0
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117741418
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741418%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117741418: 0
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Found listing with ID: 117763955
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763955%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Scrape type for 117763955: 1
2025-12-04 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6d9bff29-fc6f-566f-847f-5a24bf78479e with identifier: 117061252
2025-12-04 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6d9bff29-fc6f-566f-847f-5a24bf78479e with identifier: 117061252
2025-12-04 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6d9bff29-fc6f-566f-847f-5a24bf78479e with identifier: 117061252 to the API
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117061252?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6d9bff29-fc6f-566f-847f-5a24bf78479e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET66KNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117061252',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 64186,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-31',
 'seller_name': 'Mann Island Finance',
 'title': 'FIAT 500 HATCHBACK 1.2 Pop Star 3dr',
 'transmission': 'manual',
 'trim': '1.2 Pop Star 3dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117061252%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Saving data for 117061252: {'auction_closing_time': 1765188000.0, 'created_time': 1764442904.425784, 'last_price_update_time': 1764874842.373705}
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117061252') HTTP/1.1" 204 0
2025-12-04 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with identifier: 117489691
2025-12-04 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with identifier: 117489691
2025-12-04 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ec3f6c10-6e45-5187-b98a-6bc3b9f30cef with identifier: 117489691 to the API
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117489691?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ec3f6c10-6e45-5187-b98a-6bc3b9f30cef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MJ17DZB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117489691',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 54609,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'Mann Island Finance',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 82 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 82 Flair 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117489691%27 HTTP/1.1" 200 None
2025-12-04 19:00:42 [astonbarclay.gb] INFO: Saving data for 117489691: {'auction_closing_time': 1765188000.0, 'created_time': 1764407009.708732, 'last_price_update_time': 1764874842.772281}
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117489691') HTTP/1.1" 204 0
2025-12-04 19:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6575e71f-0d7c-5883-a249-b9e7adb3895d with identifier: 117366956
2025-12-04 19:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6575e71f-0d7c-5883-a249-b9e7adb3895d with identifier: 117366956
2025-12-04 19:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6575e71f-0d7c-5883-a249-b9e7adb3895d with identifier: 117366956 to the API
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117366956?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6575e71f-0d7c-5883-a249-b9e7adb3895d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YE69DWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117366956',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 48364,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-25',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 180 Urban Edition 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 180 Urban Edition 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366956%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Saving data for 117366956: {'auction_closing_time': 1765188000.0, 'created_time': 1764407015.739818, 'last_price_update_time': 1764874843.044526}
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117366956') HTTP/1.1" 204 0
2025-12-04 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e6d689cf-3953-5e33-a25d-f97bc38a3588 with identifier: 117420392
2025-12-04 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e6d689cf-3953-5e33-a25d-f97bc38a3588 with identifier: 117420392
2025-12-04 19:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e6d689cf-3953-5e33-a25d-f97bc38a3588 with identifier: 117420392 to the API
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117420392?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e6d689cf-3953-5e33-a25d-f97bc38a3588',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BT69VCE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117420392',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 DIESEL SPORTBACK',
 'odometer': 67169,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-27',
 'seller_name': 'Mann Island Finance',
 'title': 'AUDI A3 DIESEL SPORTBACK 35 TDI Sport 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '35 TDI Sport 5dr S Tronic',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117420392%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Saving data for 117420392: {'auction_closing_time': 1765188000.0, 'created_time': 1764407007.534935, 'last_price_update_time': 1764874843.327472}
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117420392') HTTP/1.1" 204 0
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117452073
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452073%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117452073: 0
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117135963
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117135963: 2
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117418330?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117427857?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117267405
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117267405: 2
2025-12-04 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117002721
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117002721: 2
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117270372
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117270372%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117270372: 0
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117311708
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117311708: 2
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252Ffed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117741256
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741256%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117741256: 0
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117634236
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634236%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117634236: 1
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117418330, 'registration': 'LX71NNZ', 'account': 'MAN027', 'make': 'PORSCHE', 'model': 'TAYCAN CROSS TURISMO', 'derivative': '420kW 4S 93kWh 5dr Auto', 'mileage': 46287, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2033, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-10-26', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/73d78158-f0fb-441a-afdc-a891bde926a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/87cf3db6-796a-46d8-8e0b-64b6911d6920_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/632c1455-dd1f-443c-8efb-b6437c9aaac1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/4b7ab8a4-8da3-4bbd-9fce-c27d25c875dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/dd547573-ad07-49b6-bb21-b56016647f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/6757f50e-7be8-4683-8640-96a4fba1978f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/438ee34d-bf32-4a8b-b1d8-6ed56a2838e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/8821431f-816b-4673-b332-f2cebccfa700_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 36K 45K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e041bd4a-3e5b-415d-aabc-3b8333fd50e1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117418330, 'registration': 'LX71NNZ', 'account': 'MAN027', 'make': 'PORSCHE', 'model': 'TAYCAN CROSS TURISMO', 'derivative': '420kW 4S 93kWh 5dr Auto', 'mileage': 46287, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2033, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-10-26', 'fuel': 'Electric', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/73d78158-f0fb-441a-afdc-a891bde926a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/87cf3db6-796a-46d8-8e0b-64b6911d6920_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/632c1455-dd1f-443c-8efb-b6437c9aaac1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/4b7ab8a4-8da3-4bbd-9fce-c27d25c875dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/dd547573-ad07-49b6-bb21-b56016647f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/6757f50e-7be8-4683-8640-96a4fba1978f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/438ee34d-bf32-4a8b-b1d8-6ed56a2838e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX71NNZ/2025-11-21/image/8821431f-816b-4673-b332-f2cebccfa700_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 36K 45K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e041bd4a-3e5b-415d-aabc-3b8333fd50e1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f1600c-b45e-5549-ad02-b95218864c12 with identifier: 117418330
2025-12-04 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f1600c-b45e-5549-ad02-b95218864c12 with scrape type 2
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f1600c-b45e-5549-ad02-b95218864c12 with scrape type 2
2025-12-04 19:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 96f1600c-b45e-5549-ad02-b95218864c12, identifier: 117418330
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117427857, 'registration': 'HX18WTG', 'account': 'MAN027', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '3.0d V6 S 5dr Auto AWD', 'mileage': 64021, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2042, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-15', 'fuel': 'Diesel', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HX18WTG/2025-11-24/image/8657cdf0-78a4-4613-bceb-61fa96a0fe28_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/e62f7679-0851-4910-b95f-86008fa8f93e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/2866e66f-de4b-42df-9dcc-16af876ad5fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/6300b1ac-a152-4ce1-8b4b-dd18ef3b202b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/58cc2162-569d-48bf-be79-99bab7facb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/4c130652-20c8-43e1-82e8-cafd6deb5fad_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/b7bc23dd-4848-4d28-a0e3-1cf3b3cdc4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/7e36bb85-800a-4e36-a857-9c7e84e54f51_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/f864d243-c90f-4b2d-a557-cab1669df5ee_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/18-2K 03/19-11K 07/22-33K 07/23-42K 07/24-51K 07/25-61K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 31K 38K 47K 56K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8f4bae1-56a4-4c5d-b9f2-2a8bff021f1c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117427857, 'registration': 'HX18WTG', 'account': 'MAN027', 'make': 'JAGUAR', 'model': 'F-PACE DIESEL ESTATE', 'derivative': '3.0d V6 S 5dr Auto AWD', 'mileage': 64021, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2042, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-15', 'fuel': 'Diesel', 'motExpiry': '2026-02-01', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HX18WTG/2025-11-24/image/8657cdf0-78a4-4613-bceb-61fa96a0fe28_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/e62f7679-0851-4910-b95f-86008fa8f93e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/2866e66f-de4b-42df-9dcc-16af876ad5fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/6300b1ac-a152-4ce1-8b4b-dd18ef3b202b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/58cc2162-569d-48bf-be79-99bab7facb3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/4c130652-20c8-43e1-82e8-cafd6deb5fad_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/b7bc23dd-4848-4d28-a0e3-1cf3b3cdc4de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/7e36bb85-800a-4e36-a857-9c7e84e54f51_removebg.jpg?w=600', 'https://abimg003.imgix.net/HX18WTG/2025-11-24/image/f864d243-c90f-4b2d-a557-cab1669df5ee_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 06/18-2K 03/19-11K 07/22-33K 07/23-42K 07/24-51K 07/25-61K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 31K 38K 47K 56K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 159, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8f4bae1-56a4-4c5d-b9f2-2a8bff021f1c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef2b0a91-69b4-53df-b057-0b89a66ee8bf with identifier: 117427857
2025-12-04 19:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ef2b0a91-69b4-53df-b057-0b89a66ee8bf with scrape type 2
2025-12-04 19:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ef2b0a91-69b4-53df-b057-0b89a66ee8bf with scrape type 2
2025-12-04 19:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ef2b0a91-69b4-53df-b057-0b89a66ee8bf, identifier: 117427857
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Found listing with ID: 117767385
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767385%27 HTTP/1.1" 200 None
2025-12-04 19:00:43 [astonbarclay.gb] INFO: Scrape type for 117767385: 1
2025-12-04 19:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 96f1600c-b45e-5549-ad02-b95218864c12 with identifier: 117418330
2025-12-04 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 96f1600c-b45e-5549-ad02-b95218864c12 with identifier: 117418330
2025-12-04 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mann island finance', 'price_includes_vat': False, 'title': 'porsche taycan cross turismo 420kw 4s 93kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'porsche', 'model': 'taycan cross turismo', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 46287, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418330', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '420kw 4s 93kwh 5dr auto', 'license_plate': 'lx71nnz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '96f1600c-b45e-5549-ad02-b95218864c12', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'porsche taycan cross turismo', 'sanitized_make': 'porsche', 'odometer_in_km': 74491} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '96f1600c-b45e-5549-ad02-b95218864c12',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lx71nnz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418330',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'porsche',
     'make_model': 'porsche taycan cross turismo',
     'model': 'taycan cross turismo',
     'odometer': 46287,
     'odometer_in_km': 74491,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'porsche',
     'seller_name': 'mann island finance',
     'title': 'porsche taycan cross turismo 420kw 4s 93kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '420kw 4s 93kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-04 19:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 96f1600c-b45e-5549-ad02-b95218864c12 spider: astonbarclay.gb
2025-12-04 19:00:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 96f1600c-b45e-5549-ad02-b95218864c12 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'mann island finance', 'price_includes_vat': False, 'title': 'porsche taycan cross turismo 420kw 4s 93kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'porsche', 'model': 'taycan cross turismo', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 46287, 'odometer_reading_unit': 'mi', 'registration_date': '2021-10-26', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418330', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '420kw 4s 93kwh 5dr auto', 'license_plate': 'lx71nnz', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '96f1600c-b45e-5549-ad02-b95218864c12', 'current_year_diff': 4, 'age_in_months': 49, 'make_model': 'porsche taycan cross turismo', 'sanitized_make': 'porsche', 'odometer_in_km': 74491} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 49,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '96f1600c-b45e-5549-ad02-b95218864c12',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lx71nnz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418330',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'porsche',
     'make_model': 'porsche taycan cross turismo',
     'model': 'taycan cross turismo',
     'odometer': 46287,
     'odometer_in_km': 74491,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-10-26',
     'sanitized_make': 'porsche',
     'seller_name': 'mann island finance',
     'title': 'porsche taycan cross turismo 420kw 4s 93kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '420kw 4s 93kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '96f1600c-b45e-5549-ad02-b95218864c12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX71NNZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117418330',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PORSCHE',
 'model': 'TAYCAN CROSS TURISMO',
 'odometer': 46287,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-26',
 'seller_name': 'Mann Island Finance',
 'title': 'PORSCHE TAYCAN CROSS TURISMO 420kW 4S 93kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '420kW 4S 93kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117418330%27 HTTP/1.1" 200 None
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Saving data for 117418330: {'auction_closing_time': 1765188000.0, 'created_time': 1764406979.043119, 'last_price_update_time': 1764874844.092228}
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117418330') HTTP/1.1" 204 0
2025-12-04 19:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ef2b0a91-69b4-53df-b057-0b89a66ee8bf with identifier: 117427857
2025-12-04 19:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ef2b0a91-69b4-53df-b057-0b89a66ee8bf with identifier: 117427857
2025-12-04 19:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ef2b0a91-69b4-53df-b057-0b89a66ee8bf with identifier: 117427857 to the API
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117427857?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ef2b0a91-69b4-53df-b057-0b89a66ee8bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HX18WTG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117427857',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'F-PACE DIESEL ESTATE',
 'odometer': 64021,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-15',
 'seller_name': 'Mann Island Finance',
 'title': 'JAGUAR F-PACE DIESEL ESTATE 3.0d V6 S 5dr Auto AWD',
 'transmission': 'automatic',
 'trim': '3.0d V6 S 5dr Auto AWD',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427857%27 HTTP/1.1" 200 None
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Saving data for 117427857: {'auction_closing_time': 1765188000.0, 'created_time': 1764406969.705278, 'last_price_update_time': 1764874844.554639}
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117427857') HTTP/1.1" 204 0
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Found listing with ID: 114036273
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Scrape type for 114036273: 2
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c15550>
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605302, 'registration': 'HK72VGF', 'account': 'ALL016', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 21811, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K - 09/25 21K', 'remarks': 'VOSA STATES 21K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f350f290-78db-4e02-be07-a5b8d09ed44b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605302, 'registration': 'HK72VGF', 'account': 'ALL016', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 21811, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-02-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d2097441-a9b8-4c03-99f6-9cdbf47e5cd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/8fa20397-93b8-4d4f-8652-a9d4e42798aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/bf126592-2a72-40c3-9064-5c235f25b613_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/c1545413-1741-4155-9a15-6aea8b49b4df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/82675e9d-48ff-4af7-8324-278e13a980c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a3164988-f4b7-4226-a441-f55defec4c4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/a203dec2-b260-49f5-afa2-7eeafebe3134_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/d6a6a3a1-e97e-4aa5-ba6d-d2c36eeeb53c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/3622391d-1fae-47c8-abc6-4a8ffb54a62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HK72VGF/2025-12-02/image/5b622055-c3ba-49c8-b3f7-0bdd21d165ff_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/24 6K - 09/25 21K', 'remarks': 'VOSA STATES 21K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f350f290-78db-4e02-be07-a5b8d09ed44b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-04 19:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cbeb631d-6470-5e0f-b9cc-332242767dc1 with scrape type 2
2025-12-04 19:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cbeb631d-6470-5e0f-b9cc-332242767dc1 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cbeb631d-6470-5e0f-b9cc-332242767dc1, identifier: 117605302
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117189741?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117545534?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117077436?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-04 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302
2025-12-04 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cbeb631d-6470-5e0f-b9cc-332242767dc1 with identifier: 117605302 to the API
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605302?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cbeb631d-6470-5e0f-b9cc-332242767dc1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HK72VGF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605302',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 21811,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-06',
 'seller_name': 'SMC GROUP',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2023}
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605302%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Saving data for 117605302: {'auction_closing_time': 1765188000.0, 'created_time': 1764702175.007204, 'last_price_update_time': 1764874845.364982}
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605302') HTTP/1.1" 204 0
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117641304
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641304%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117641304: 0
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117310723
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117310723: 2
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252Fe0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117421533
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117421533: 2
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117189741, 'registration': 'LS20EVF', 'account': 'AST003', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X 5dr', 'mileage': 44712, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS20EVF/2025-11-21/image/55bb3d38-6a1a-4600-9365-9023d0ad9e53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/8775fd0e-f68f-47f8-a0ce-d372a0a3ead9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/a18dd180-ccb6-4a82-8947-cbbcfcb72ce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/6fd1c91a-704e-469c-a3d0-c881d22a5bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/7f0b63f7-9175-4f27-b347-8770117cb828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/1f999467-ebc9-4e4e-a160-3087cd12f2b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/ef6ea3ab-dc55-4f85-b0eb-15bd90da1ce3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/bd0c9d2b-5edc-42f6-b695-d22cabfdf38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/61046587-c280-48d4-a6d0-1110f0f0db10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/dcc2aa36-9ada-40ee-ac31-0cfe80bb063f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 10/24 38K', 'remarks': '**NO FIRST GEAR** VOSA STATES 21K- 32K- 44K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eaaabb9c-ce3c-46a4-89d4-ca7b2b7350e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117189741, 'registration': 'LS20EVF', 'account': 'AST003', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line X 5dr', 'mileage': 44712, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-06-19', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LS20EVF/2025-11-21/image/55bb3d38-6a1a-4600-9365-9023d0ad9e53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/8775fd0e-f68f-47f8-a0ce-d372a0a3ead9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/a18dd180-ccb6-4a82-8947-cbbcfcb72ce2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/6fd1c91a-704e-469c-a3d0-c881d22a5bd0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/7f0b63f7-9175-4f27-b347-8770117cb828_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/1f999467-ebc9-4e4e-a160-3087cd12f2b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/ef6ea3ab-dc55-4f85-b0eb-15bd90da1ce3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/bd0c9d2b-5edc-42f6-b695-d22cabfdf38a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/61046587-c280-48d4-a6d0-1110f0f0db10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20EVF/2025-11-21/image/dcc2aa36-9ada-40ee-ac31-0cfe80bb063f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 10/24 38K', 'remarks': '**NO FIRST GEAR** VOSA STATES 21K- 32K- 44K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eaaabb9c-ce3c-46a4-89d4-ca7b2b7350e9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-12-04 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d890f37-fd6f-5356-92e4-7275c95936de with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d890f37-fd6f-5356-92e4-7275c95936de with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d890f37-fd6f-5356-92e4-7275c95936de, identifier: 117189741
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117545534, 'registration': 'AK18MKN', 'account': 'ALL018', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 82059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AK18MKN/2025-12-02/image/b85998ab-3dda-402b-a6f6-905b73a3502a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/b68aac80-415a-4c20-99b1-3c5dd07e143f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/c6b396a7-df24-46f6-be87-f61d0da6ae89_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/3c60e411-b851-4d48-a41f-c5c410897dce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/75301d5d-bc66-426f-a27e-377d8e52797e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/1d49f551-5945-4446-b1cc-db1a8e93995e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/2ed7bff4-cfcd-4eb4-9abb-2251a899b505_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/fb6828b8-5515-418e-885d-18e0eecbb425_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/9b89ea93-8037-4146-a1e9-7280340f5db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/3f01a12d-b2f8-4a27-82d4-07ba7c22fbf6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/20-23K 02/22-44K 06/23-63K 08/24-71K', 'remarks': 'VOSA STATES 59K 65K 73K 81K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/952a27e7-b498-4d08-b26c-9b74d666a28c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117545534, 'registration': 'AK18MKN', 'account': 'ALL018', 'make': 'SKODA', 'model': 'OCTAVIA ESTATE', 'derivative': '1.0 TSI SE Technology 5dr', 'mileage': 82059, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-05-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-06', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AK18MKN/2025-12-02/image/b85998ab-3dda-402b-a6f6-905b73a3502a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/b68aac80-415a-4c20-99b1-3c5dd07e143f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/c6b396a7-df24-46f6-be87-f61d0da6ae89_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/3c60e411-b851-4d48-a41f-c5c410897dce_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/75301d5d-bc66-426f-a27e-377d8e52797e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/1d49f551-5945-4446-b1cc-db1a8e93995e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/2ed7bff4-cfcd-4eb4-9abb-2251a899b505_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/fb6828b8-5515-418e-885d-18e0eecbb425_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/9b89ea93-8037-4146-a1e9-7280340f5db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AK18MKN/2025-12-02/image/3f01a12d-b2f8-4a27-82d4-07ba7c22fbf6_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/20-23K 02/22-44K 06/23-63K 08/24-71K', 'remarks': 'VOSA STATES 59K 65K 73K 81K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/952a27e7-b498-4d08-b26c-9b74d666a28c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-04 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24, identifier: 117545534
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117077436, 'registration': 'LV70DKK', 'account': 'STE009', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive45e M Sport 5dr Auto', 'mileage': 145107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-13', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-11-12', 'doors': 5, 'engineSize': 2998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5019cff0-c8a1-4a28-bcd4-edb47ca76122_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/a80ee9f1-9600-4309-84f7-2bb60118545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/0130de73-b247-442e-bf81-0749cc5fcf55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/ef26fb95-fcfa-4730-bef8-b80bb568b53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5418af2d-94c9-466d-9a8d-7c4d34b28a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/d023e148-8d35-4232-bc07-6044fe3ee2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/1c5a05d5-1f8e-4f85-b1ab-bbfafb962ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/3a2321d5-2d38-4676-8613-3f4d591d0468_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/24e26f48-dfbb-4be8-b705-f64c1779d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/411b5571-a89f-4112-bc0c-2eb266ada736_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/89cb84a4-35ca-4cf1-a64f-a7d1f505e180_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/21-21K, 06/22-41K, 12/22-60K, 08/23-79K, 03/24-100K, 11/24-120K. 08/25 139K', 'remarks': 'VOSA STATES MILES@ 85K, 120K, 145K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f46333f8-d074-4029-b52b-9f39ce1b61cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117077436, 'registration': 'LV70DKK', 'account': 'STE009', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive45e M Sport 5dr Auto', 'mileage': 145107, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-11-13', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-11-12', 'doors': 5, 'engineSize': 2998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5019cff0-c8a1-4a28-bcd4-edb47ca76122_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/a80ee9f1-9600-4309-84f7-2bb60118545c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/0130de73-b247-442e-bf81-0749cc5fcf55_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/ef26fb95-fcfa-4730-bef8-b80bb568b53d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/5418af2d-94c9-466d-9a8d-7c4d34b28a3b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/d023e148-8d35-4232-bc07-6044fe3ee2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/1c5a05d5-1f8e-4f85-b1ab-bbfafb962ae3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/3a2321d5-2d38-4676-8613-3f4d591d0468_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/24e26f48-dfbb-4be8-b705-f64c1779d94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/411b5571-a89f-4112-bc0c-2eb266ada736_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV70DKK/2025-11-20/image/89cb84a4-35ca-4cf1-a64f-a7d1f505e180_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/21-21K, 06/22-41K, 12/22-60K, 08/23-79K, 03/24-100K, 11/24-120K. 08/25 139K', 'remarks': 'VOSA STATES MILES@ 85K, 120K, 145K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f46333f8-d074-4029-b52b-9f39ce1b61cf.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-04 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5da27d14-4d62-5be5-add6-1800c7249336 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5da27d14-4d62-5be5-add6-1800c7249336 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5da27d14-4d62-5be5-add6-1800c7249336, identifier: 117077436
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116994676, 'registration': 'LA70WBL', 'account': 'RIC072', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Elite 5dr Auto', 'mileage': 34873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-02-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-21', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e0d6548-607b-482e-adb1-f475e672cd06_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2831fe1e-078f-47b7-8cf7-210553a349b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/2e2fa0f8-791a-4aa6-a600-dfa9827c0425_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/bbbbf86a-955f-4e96-8afa-77d7478de6ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/fe6ce191-71a7-4ef0-bef4-2920d01fa878_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/d79e0f74-8d8f-4809-a114-bee2346e222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/905e19e4-65ac-4458-b125-ff9910f36a12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/3d10a9d3-dd71-4675-9034-acbd1976d202_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA70WBL/2025-11-12/image/c90b1af9-ccf5-4cf5-94ca-b60d446913f8_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 5/24 23K', 'remarks': 'VOSA STATES 22K, 23K, 32K', 'virtual': False, 'seller': 'Richard Nash Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4136264-5507-4695-8198-54c833c850cc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-04 19:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6004262-a547-515d-91d0-1af151fe54f7 with scrape type 2
2025-12-04 19:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6004262-a547-515d-91d0-1af151fe54f7, identifier: 116994676
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Found listing with ID: 117406735
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-04 19:00:45 [astonbarclay.gb] INFO: Scrape type for 117406735: 2
2025-12-04 19:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117376148?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-12-04 19:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741
2025-12-04 19:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d890f37-fd6f-5356-92e4-7275c95936de with identifier: 117189741 to the API
2025-12-04 19:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117189741?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d890f37-fd6f-5356-92e4-7275c95936de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS20EVF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117189741',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 44712,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-19',
 'seller_name': 'TCB Group - Value',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line X 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117189741%27 HTTP/1.1" 200 None
2025-12-04 19:00:46 [astonbarclay.gb] INFO: Saving data for 117189741: {'auction_closing_time': 1765188000.0, 'created_time': 1763715708.097447, 'last_price_update_time': 1764874846.25749}
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117189741') HTTP/1.1" 204 0
2025-12-04 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-04 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534
2025-12-04 19:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24 with identifier: 117545534 to the API
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24%27 HTTP/1.1" 200 None
2025-12-04 19:00:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:45 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117545534?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2e6dacb7-11d7-5ff4-bd8c-ce1a62cb7d24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AK18MKN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117545534',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'OCTAVIA ESTATE',
 'odometer': 82059,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-10',
 'seller_name': 'SMC GROUP',
 'title': 'SKODA OCTAVIA ESTATE 1.0 TSI SE Technology 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE Technology 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117545534%27 HTTP/1.1" 200 None
2025-12-04 19:00:46 [astonbarclay.gb] INFO: Saving data for 117545534: {'auction_closing_time': 1765188000.0, 'created_time': 1764615805.867672, 'last_price_update_time': 1764874846.629721}
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117545534') HTTP/1.1" 204 0
2025-12-04 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Hybrid+Electric HTTP/1.1" 200 None
2025-12-04 19:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5da27d14-4d62-5be5-add6-1800c7249336 with identifier: 117077436
2025-12-04 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hedin automotive bmw', 'price_includes_vat': False, 'title': 'bmw x5 estate xdrive45e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x5 estate', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'hybrid electric', 'odometer': 145107, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'xdrive45e m sport 5dr auto', 'license_plate': 'lv70dkk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 29, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5da27d14-4d62-5be5-add6-1800c7249336', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'bmw x5 estate', 'sanitized_make': 'bmw', 'odometer_in_km': 233526}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 29,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'hybrid electric',
     'id': '5da27d14-4d62-5be5-add6-1800c7249336',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv70dkk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw x5 estate',
     'model': 'x5 estate',
     'odometer': 145107,
     'odometer_in_km': 233526,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-13',
     'sanitized_make': 'bmw',
     'seller_name': 'hedin automotive bmw',
     'title': 'bmw x5 estate xdrive45e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive45e m sport 5dr auto',
     'vin': None,
     'year': 2020}
2025-12-04 19:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 5da27d14-4d62-5be5-add6-1800c7249336 spider: astonbarclay.gb
2025-12-04 19:00:47 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5da27d14-4d62-5be5-add6-1800c7249336 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'hedin automotive bmw', 'price_includes_vat': False, 'title': 'bmw x5 estate xdrive45e m sport 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': 'x5 estate', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'hybrid electric', 'odometer': 145107, 'odometer_reading_unit': 'mi', 'registration_date': '2020-11-13', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': 'xdrive45e m sport 5dr auto', 'license_plate': 'lv70dkk', 'year': 2020, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 29, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '5da27d14-4d62-5be5-add6-1800c7249336', 'current_year_diff': 5, 'age_in_months': 60, 'make_model': 'bmw x5 estate', 'sanitized_make': 'bmw', 'odometer_in_km': 233526}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 60,
     'auction_title': '',
     'c_o_2_emission_value': 29,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 5,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'hybrid electric',
     'id': '5da27d14-4d62-5be5-add6-1800c7249336',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'lv70dkk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'bmw',
     'make_model': 'bmw x5 estate',
     'model': 'x5 estate',
     'odometer': 145107,
     'odometer_in_km': 233526,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2020-11-13',
     'sanitized_make': 'bmw',
     'seller_name': 'hedin automotive bmw',
     'title': 'bmw x5 estate xdrive45e m sport 5dr auto',
     'transmission': 'automatic',
     'trim': 'xdrive45e m sport 5dr auto',
     'vin': None,
     'year': 2020}
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '5da27d14-4d62-5be5-add6-1800c7249336',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV70DKK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117077436',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 ESTATE',
 'odometer': 145107,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-13',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW X5 ESTATE xDrive45e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive45e M Sport 5dr Auto',
 'vin': None,
 'year': 2020}
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117077436%27 HTTP/1.1" 200 None
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Saving data for 117077436: {'auction_closing_time': 1765188000.0, 'created_time': 1762974216.288209, 'last_price_update_time': 1764874847.026262}
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117077436') HTTP/1.1" 204 0
2025-12-04 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-04 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676
2025-12-04 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a6004262-a547-515d-91d0-1af151fe54f7 with identifier: 116994676 to the API
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116994676?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a6004262-a547-515d-91d0-1af151fe54f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LA70WBL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116994676',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 34873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-16',
 'seller_name': 'Richard Nash Group',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Elite 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Elite 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116994676%27 HTTP/1.1" 200 None
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Saving data for 116994676: {'auction_closing_time': 1765188000.0, 'created_time': 1763024478.604471, 'last_price_update_time': 1764874847.335246}
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116994676') HTTP/1.1" 204 0
2025-12-04 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117596515
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117596515%27 HTTP/1.1" 200 None
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117596515: 0
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Found listing with ID: 117240480
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240480%27 HTTP/1.1" 200 None
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Scrape type for 117240480: 2
2025-12-04 19:00:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117422977?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a5f750>
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252Ffed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117563502, 'registration': 'WV68ZBX', 'account': 'STE009', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr Auto', 'mileage': 55097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/6fc01b98-c042-4478-95db-aee55498cd18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/772a810f-ab23-4c71-9c48-da5e3808113f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/8e9744ee-2d85-4218-9d5f-4b6cdb1139d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/2b12a565-b542-4afb-a565-10557c3f4e21_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/df1ce5f1-8c85-4ae5-bce3-00b7c888e55a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/fd0b0e42-a4b6-4dc1-87a2-c284fd970352_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/99c2012d-a88d-4200-a998-d1ae38973bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/6e5d8037-3e23-4235-92a7-817848cd1676_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/19-4K 08/20-10K 05/21-15K 05/22-23K 02/23-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 30K 37K 49K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09b42d16-f9d2-4382-940e-e84889194c27.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117563502, 'registration': 'WV68ZBX', 'account': 'STE009', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr Auto', 'mileage': 55097, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-09-28', 'fuel': 'Diesel', 'motExpiry': '2026-03-18', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/6fc01b98-c042-4478-95db-aee55498cd18_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/772a810f-ab23-4c71-9c48-da5e3808113f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/8e9744ee-2d85-4218-9d5f-4b6cdb1139d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/2b12a565-b542-4afb-a565-10557c3f4e21_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/df1ce5f1-8c85-4ae5-bce3-00b7c888e55a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/fd0b0e42-a4b6-4dc1-87a2-c284fd970352_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/99c2012d-a88d-4200-a998-d1ae38973bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV68ZBX/2025-12-02/image/6e5d8037-3e23-4235-92a7-817848cd1676_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/19-4K 08/20-10K 05/21-15K 05/22-23K 02/23-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 23K 30K 37K 49K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/09b42d16-f9d2-4382-940e-e84889194c27.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-04 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with scrape type 2
2025-12-04 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with scrape type 2
2025-12-04 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 15f02e94-b6b8-5898-baab-8d66d2e3eb15, identifier: 117563502
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576078, 'registration': 'LV22BSX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 13183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a8050ce-df3b-48a8-9d20-ba1dfc7878c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576078, 'registration': 'LV22BSX', 'account': 'MER167', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK', 'derivative': 'GLA 200 AMG Line Premium 5dr Auto', 'mileage': 13183, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-14', 'fuel': 'Petrol', 'motExpiry': '2026-05-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f67781b8-6a3a-4511-8d0b-db46a7bce23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/b8be238b-5f38-46a9-9091-99911abefaeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/05eb512c-813b-4e5d-95f5-fd51626b4ac5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/34efc721-5d09-4f98-8269-6cec7c402936_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/da2007e4-588b-48db-8e4f-baba97535507_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/efcd5959-e99a-4836-a568-d5de20943c2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/f2f44ac0-22c4-4e06-a4b0-8b2318e1aa31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/121f1a1c-cae5-4087-8b77-142d917a6b27_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/fa3fb67b-dfcb-4a6f-ab35-4bfc8a31420a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV22BSX/2025-12-01/image/320ef761-bd02-47d6-b931-ef1f5cf97e6d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 8K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6a8050ce-df3b-48a8-9d20-ba1dfc7878c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-04 19:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49ea86bd-0188-543f-9dff-87dbf2d122aa with scrape type 2
2025-12-04 19:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49ea86bd-0188-543f-9dff-87dbf2d122aa with scrape type 2
2025-12-04 19:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49ea86bd-0188-543f-9dff-87dbf2d122aa, identifier: 117576078
2025-12-04 19:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-04 19:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502
2025-12-04 19:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 15f02e94-b6b8-5898-baab-8d66d2e3eb15 with identifier: 117563502 to the API
2025-12-04 19:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117563502?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '15f02e94-b6b8-5898-baab-8d66d2e3eb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WV68ZBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117563502',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER DIESEL ESTATE',
 'odometer': 55097,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 4 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 DI-D 4 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563502%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Saving data for 117563502: {'auction_closing_time': 1765188000.0, 'created_time': 1764615670.677686, 'last_price_update_time': 1764874848.140379}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117563502') HTTP/1.1" 204 0
2025-12-04 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-04 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078
2025-12-04 19:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 49ea86bd-0188-543f-9dff-87dbf2d122aa with identifier: 117576078 to the API
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576078?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '49ea86bd-0188-543f-9dff-87dbf2d122aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV22BSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576078',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK',
 'odometer': 13183,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-14',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ GLA HATCHBACK GLA 200 AMG Line Premium 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 200 AMG Line Premium 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576078%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Saving data for 117576078: {'auction_closing_time': 1765188000.0, 'created_time': 1764615793.473383, 'last_price_update_time': 1764874848.48272}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576078') HTTP/1.1" 204 0
2025-12-04 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 117707935
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707935%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Scrape type for 117707935: 0
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 116321191
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Scrape type for 116321191: 2
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117376148, 'registration': 'LY68KVG', 'account': 'STE093', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 3 5dr CVT', 'mileage': 106913, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-12', 'fuel': 'Petrol', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY68KVG/2025-11-27/image/534795c2-4654-4c12-8386-44798cf3da83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/4d4d3e36-9555-4cfe-a646-bf0cbc052aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/151982de-5294-4e77-8c7d-b951779dba46_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/03bff6a1-0527-48ed-85f1-c3f9d64aa66f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/58a1df79-777c-4132-a00b-f384181cc1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/686fa622-3c42-4a97-b82a-665b1a7dde4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/685335cb-d9a9-4cf1-b560-6cff5b6cdb2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/e2ad7829-88d8-44ed-bf3a-89b4f3aef2cf_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 14K - 02/21 24K - 01/22 40K - 12/22 55K - 01/24 76K - 01/25 93K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 55K 76K 93K 106K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc240678-74ba-4434-8e20-190803709686.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117376148, 'registration': 'LY68KVG', 'account': 'STE093', 'make': 'MITSUBISHI', 'model': 'ECLIPSE CROSS HATCHBACK', 'derivative': '1.5 3 5dr CVT', 'mileage': 106913, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-01-12', 'fuel': 'Petrol', 'motExpiry': '2026-11-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY68KVG/2025-11-27/image/534795c2-4654-4c12-8386-44798cf3da83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/4d4d3e36-9555-4cfe-a646-bf0cbc052aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/151982de-5294-4e77-8c7d-b951779dba46_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/03bff6a1-0527-48ed-85f1-c3f9d64aa66f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/58a1df79-777c-4132-a00b-f384181cc1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/686fa622-3c42-4a97-b82a-665b1a7dde4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/685335cb-d9a9-4cf1-b560-6cff5b6cdb2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY68KVG/2025-11-27/image/e2ad7829-88d8-44ed-bf3a-89b4f3aef2cf_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 14K - 02/21 24K - 01/22 40K - 12/22 55K - 01/24 76K - 01/25 93K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 55K 76K 93K 106K', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bc240678-74ba-4434-8e20-190803709686.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d with identifier: 117376148
2025-12-04 19:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca088e64-2bc7-5f89-9fab-e1fd3e13f28d with scrape type 2
2025-12-04 19:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca088e64-2bc7-5f89-9fab-e1fd3e13f28d with scrape type 2
2025-12-04 19:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d, identifier: 117376148
2025-12-04 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d with identifier: 117376148
2025-12-04 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d with identifier: 117376148
2025-12-04 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172059 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172059
2025-12-04 19:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d spider: astonbarclay.gb
2025-12-04 19:00:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ca088e64-2bc7-5f89-9fab-e1fd3e13f28d due to rule: high_mileage_for_country.json, error: 172059 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172059
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ca088e64-2bc7-5f89-9fab-e1fd3e13f28d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY68KVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117376148',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'ECLIPSE CROSS HATCHBACK',
 'odometer': 106913,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-12',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MITSUBISHI ECLIPSE CROSS HATCHBACK 1.5 3 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 3 5dr CVT',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117376148%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Saving data for 117376148: {'auction_closing_time': 1765188000.0, 'created_time': 1764184250.509755, 'last_price_update_time': 1764874848.903101}
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117376148') HTTP/1.1" 204 0
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 117683297
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117683297%27 HTTP/1.1" 200 None
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Scrape type for 117683297: 0
2025-12-04 19:00:48 [astonbarclay.gb] INFO: Found listing with ID: 117023546
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-12-04 19:00:49 [astonbarclay.gb] INFO: Scrape type for 117023546: 2
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c1e390>
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6955890>
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117422977, 'registration': 'LB25FCZ', 'account': 'MER176', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6T Hybrid N Line S 5dr Auto', 'mileage': 5305, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/e5e2b506-7326-4275-a587-28e3eb74e290_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/884cdd3c-e0bc-49cb-b6c3-c0f2dad7f776_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/faa0277b-ad3f-47b2-8835-14f97bbedfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/84cafb43-f57d-4ce7-a708-b6341bbf6815_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/35ecf050-e979-4683-8576-252f7508d628_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/93b286e3-0368-409b-9642-011793f0fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/c221fc91-bf92-49bc-8608-99c1840c9826_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/1974f529-8da1-4af0-bb80-30ab25dea909_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/4c8b8fd9-1b8e-4f72-933c-66ae8f2d58d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/5de2c029-933d-4a81-a3b9-5d3804cd3a4f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book EMPTY SERVICE BOOK', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14dae04b-213f-4678-ba07-b0110ccaffdc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117422977, 'registration': 'LB25FCZ', 'account': 'MER176', 'make': 'HYUNDAI', 'model': 'TUCSON ESTATE', 'derivative': '1.6T Hybrid N Line S 5dr Auto', 'mileage': 5305, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-21', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/e5e2b506-7326-4275-a587-28e3eb74e290_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/884cdd3c-e0bc-49cb-b6c3-c0f2dad7f776_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/faa0277b-ad3f-47b2-8835-14f97bbedfa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/84cafb43-f57d-4ce7-a708-b6341bbf6815_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/35ecf050-e979-4683-8576-252f7508d628_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/93b286e3-0368-409b-9642-011793f0fc0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/c221fc91-bf92-49bc-8608-99c1840c9826_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/1974f529-8da1-4af0-bb80-30ab25dea909_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/4c8b8fd9-1b8e-4f72-933c-66ae8f2d58d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB25FCZ/2025-11-28/image/5de2c029-933d-4a81-a3b9-5d3804cd3a4f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book EMPTY SERVICE BOOK', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/14dae04b-213f-4678-ba07-b0110ccaffdc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with identifier: 117422977
2025-12-04 19:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with scrape type 2
2025-12-04 19:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with scrape type 2
2025-12-04 19:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2, identifier: 117422977
2025-12-04 19:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with identifier: 117422977
2025-12-04 19:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with identifier: 117422977
2025-12-04 19:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2 with identifier: 117422977 to the API
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117422977?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'b0438cb7-a51c-5e7d-ba7e-5f91e9423fd2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB25FCZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117422977',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'TUCSON ESTATE',
 'odometer': 5305,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-21',
 'seller_name': 'Hedin Automotive',
 'title': 'HYUNDAI TUCSON ESTATE 1.6T Hybrid N Line S 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6T Hybrid N Line S 5dr Auto',
 'vin': None,
 'year': 2025}
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422977%27 HTTP/1.1" 200 None
2025-12-04 19:00:49 [astonbarclay.gb] INFO: Saving data for 117422977: {'auction_closing_time': 1765188000.0, 'created_time': 1764320482.888786, 'last_price_update_time': 1764874849.904931}
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117422977') HTTP/1.1" 204 0
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6bebd50>
2025-12-04 19:00:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_10.jpg HTTP/1.1" 201 0
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252Fe0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 117498427
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Scrape type for 117498427: 2
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117614020?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117135963?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117459934?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c332d0>
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6ab5950>
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 117022539
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Scrape type for 117022539: 2
2025-12-04 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Found listing with ID: 117357391
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-04 19:00:50 [astonbarclay.gb] INFO: Scrape type for 117357391: 2
2025-12-04 19:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117615455?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b2eb10>
2025-12-04 19:00:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117631646, 'registration': 'FE17TBU', 'account': 'ESS009', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.4 EcoTSI Xcellence 5dr', 'mileage': 80306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18 18K - 09/20 38K - 09/21 46K - 06/22 50k - 09/22 52k - 09/23 60k - 09/24 68k', 'remarks': 'VOSA STATES, 55K, 63K, 64K, 74K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d85137a-0506-4e13-8440-bed4f048f6eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117631646, 'registration': 'FE17TBU', 'account': 'ESS009', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.4 EcoTSI Xcellence 5dr', 'mileage': 80306, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-06', 'fuel': 'Petrol', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FE17TBU/2025-12-02/image/644b0dc9-9399-4166-9862-a72b108e210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/2db95366-3e57-449a-95ca-2ec56c9b2772_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/f077e1e5-e318-4905-b515-5364ae9196e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/5f50aa41-eff4-4d71-8f57-0bae72f48ed8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/35ed20ce-3bdf-4506-87bd-54c236326127_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/6a65d646-dee9-4ce1-89bb-500e945d7244_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/ba710ae2-1ca3-4e70-adb1-e4327d449361_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/034c295f-d569-4a03-91bf-94e2f0bfa825_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE17TBU/2025-12-02/image/0e0b01f7-1c94-4b37-9bb2-ff8ba479ecea_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/18 18K - 09/20 38K - 09/21 46K - 06/22 50k - 09/22 52k - 09/23 60k - 09/24 68k', 'remarks': 'VOSA STATES, 55K, 63K, 64K, 74K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d85137a-0506-4e13-8440-bed4f048f6eb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-04 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb, identifier: 117631646
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117614020, 'registration': 'KY16LYT', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 SE 5dr Auto', 'mileage': 60727, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1252, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-15', 'fuel': 'Petrol', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY16LYT/2025-12-01/image/2f97318e-7b34-4f70-a9cf-d392ba65b123_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/1fc026b3-7a99-4fac-ac4b-65a8818bf293_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/cb2df557-7803-432f-8914-e06da225dc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/9b872b4e-1a82-49bb-9b3f-abed417e1d0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/51f6cc19-5ea2-4cbf-9c39-11f2b05d555f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/95a2a204-3a1a-4b32-b8cb-4c54dc7e62c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/67f9eb3b-7ad5-4d67-b8a9-3aed4db158ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/9a19b2dd-7097-468b-b734-ccb7cb2bf890_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/0d247d17-1ed7-4f0d-8bc2-0d18c4626d12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/286f0182-6e46-456d-9e7e-5ea6644874ed_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/17-14K, 03/18-20K, 03/19-27K, 01/24-47K', 'remarks': 'VOSA STATES -  42K, 46K, 55K, 57K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/070e4061-9625-4a99-8d4c-e64b1833967b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117614020, 'registration': 'KY16LYT', 'account': 'WBA003', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A180 SE 5dr Auto', 'mileage': 60727, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1252, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-15', 'fuel': 'Petrol', 'motExpiry': '2026-01-23', 'doors': 5, 'engineSize': 1595, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KY16LYT/2025-12-01/image/2f97318e-7b34-4f70-a9cf-d392ba65b123_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/1fc026b3-7a99-4fac-ac4b-65a8818bf293_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/cb2df557-7803-432f-8914-e06da225dc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/9b872b4e-1a82-49bb-9b3f-abed417e1d0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/51f6cc19-5ea2-4cbf-9c39-11f2b05d555f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/95a2a204-3a1a-4b32-b8cb-4c54dc7e62c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/67f9eb3b-7ad5-4d67-b8a9-3aed4db158ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/9a19b2dd-7097-468b-b734-ccb7cb2bf890_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/0d247d17-1ed7-4f0d-8bc2-0d18c4626d12_removebg.jpg?w=600', 'https://abimg003.imgix.net/KY16LYT/2025-12-01/image/286f0182-6e46-456d-9e7e-5ea6644874ed_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/17-14K, 03/18-20K, 03/19-27K, 01/24-47K', 'remarks': 'VOSA STATES -  42K, 46K, 55K, 57K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/070e4061-9625-4a99-8d4c-e64b1833967b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9b3406ae-794e-5b19-8911-2a2d1617f990 with identifier: 117614020
2025-12-04 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9b3406ae-794e-5b19-8911-2a2d1617f990 with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9b3406ae-794e-5b19-8911-2a2d1617f990 with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9b3406ae-794e-5b19-8911-2a2d1617f990, identifier: 117614020
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117135963, 'registration': 'LX66LNR', 'account': 'SID006', 'make': 'AUDI', 'model': 'A3 SPORTBACK', 'derivative': '1.0 TFSI Sport 5dr', 'mileage': 84576, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-03', 'fuel': 'Petrol', 'motExpiry': '2026-03-04', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66LNR/2025-11-25/image/b58b5dd2-396f-4cb7-9ee8-b95e4927ec53_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/7d60b44f-9967-419f-9f9b-747151379cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/342067ed-2e8e-4478-a326-e02279e5210d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/661fc492-177e-4936-ac7f-04cadff40636_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/f3b2ffc4-21f0-408b-b879-3f4ae5804950_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/e3c52318-0382-443e-8ad2-f39cd51fb4aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/0594d9dd-5231-4c0c-afb0-314cfd8800de_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/deaa8a75-ed42-431f-b09f-4b7d72a416b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a13df5df-8b41-4c53-81db-a0a2c0ee03dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/84c6abf6-02df-4c12-bb7c-035e917658b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/a5135f13-e012-4237-ac2c-8b41733d5e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66LNR/2025-11-25/image/4b87a4e9-2ee6-49d4-9d2f-024ebc038068_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 ONLY -VOSA STATES 45K, 55K, 61K, 82K - SPARE KEY & SD CARD IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dd44ffd5-2a16-4a54-84fd-e8dd8d7b9bfb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-04 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45e186c8-37e8-5509-8502-2d44f8e4150f with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 45e186c8-37e8-5509-8502-2d44f8e4150f, identifier: 117135963
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117459934, 'registration': 'LS20JYL', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS SALOON', 'derivative': 'A180 AMG Line Executive 4dr Auto', 'mileage': 23315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-12', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LS20JYL/2025-11-27/image/f28115aa-8648-4cf4-be19-3c29a49d29fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/3d5ab75d-3474-4814-9324-0757b376dfa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/5fd696a2-9716-4984-b16e-172ab2bea066_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/48b4077c-60f7-4147-82dc-445c9ad24735_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/09cb82ac-668e-4991-b080-8d0689809816_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/f22fe084-9354-4a67-b334-ed90b16bf6e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/eabc713f-2577-468b-8e0b-45f2291d0709_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/33735bb9-35e5-429a-840e-6f8625b20203_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/277bad25-c179-4651-aa64-1f92c80665c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/6c966016-ab23-4eef-b0c2-1588626c031d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/21 7K - 06/22 11K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES, 14K, 17K, 21K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5574ae3c-516e-47f6-8703-7a9f90c4775c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117459934, 'registration': 'LS20JYL', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS SALOON', 'derivative': 'A180 AMG Line Executive 4dr Auto', 'mileage': 23315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-06-12', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 4, 'engineSize': 1332, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LS20JYL/2025-11-27/image/f28115aa-8648-4cf4-be19-3c29a49d29fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/3d5ab75d-3474-4814-9324-0757b376dfa4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/5fd696a2-9716-4984-b16e-172ab2bea066_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/48b4077c-60f7-4147-82dc-445c9ad24735_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/09cb82ac-668e-4991-b080-8d0689809816_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/f22fe084-9354-4a67-b334-ed90b16bf6e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/eabc713f-2577-468b-8e0b-45f2291d0709_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/33735bb9-35e5-429a-840e-6f8625b20203_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/277bad25-c179-4651-aa64-1f92c80665c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS20JYL/2025-11-27/image/6c966016-ab23-4eef-b0c2-1588626c031d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/21 7K - 06/22 11K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES, 14K, 17K, 21K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5574ae3c-516e-47f6-8703-7a9f90c4775c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1df93c93-9009-58ed-97f8-28f83032e1a3 with identifier: 117459934
2025-12-04 19:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1df93c93-9009-58ed-97f8-28f83032e1a3 with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1df93c93-9009-58ed-97f8-28f83032e1a3 with scrape type 2
2025-12-04 19:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1df93c93-9009-58ed-97f8-28f83032e1a3, identifier: 117459934
2025-12-04 19:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-04 19:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646
2025-12-04 19:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6fde9c42-a9ae-5244-82a2-b83dd84aa0eb with identifier: 117631646 to the API
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117631646?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6fde9c42-a9ae-5244-82a2-b83dd84aa0eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FE17TBU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117631646',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 80306,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-06',
 'seller_name': 'SMC GROUP',
 'title': 'SEAT ATECA ESTATE 1.4 EcoTSI Xcellence 5dr',
 'transmission': 'manual',
 'trim': '1.4 EcoTSI Xcellence 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631646%27 HTTP/1.1" 200 None
2025-12-04 19:00:52 [astonbarclay.gb] INFO: Saving data for 117631646: {'auction_closing_time': 1764936000.0, 'created_time': 1764702164.350911, 'last_price_update_time': 1764874852.030667}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117631646') HTTP/1.1" 204 0
2025-12-04 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9b3406ae-794e-5b19-8911-2a2d1617f990 with identifier: 117614020
2025-12-04 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9b3406ae-794e-5b19-8911-2a2d1617f990 with identifier: 117614020
2025-12-04 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9b3406ae-794e-5b19-8911-2a2d1617f990 with identifier: 117614020 to the API
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279b3406ae-794e-5b19-8911-2a2d1617f990%27 HTTP/1.1" 200 None
2025-12-04 19:00:52 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9b3406ae-794e-5b19-8911-2a2d1617f990: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:51 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117614020?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '9b3406ae-794e-5b19-8911-2a2d1617f990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KY16LYT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117614020',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 60727,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-15',
 'seller_name': 'UKCGR - Select',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A180 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 SE 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117614020%27 HTTP/1.1" 200 None
2025-12-04 19:00:52 [astonbarclay.gb] INFO: Saving data for 117614020: {'auction_closing_time': 1765215000.0, 'created_time': 1764442890.608501, 'last_price_update_time': 1764874852.345787}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117614020') HTTP/1.1" 204 0
2025-12-04 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-04 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963
2025-12-04 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 45e186c8-37e8-5509-8502-2d44f8e4150f with identifier: 117135963 to the API
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117135963?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '45e186c8-37e8-5509-8502-2d44f8e4150f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX66LNR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117135963',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SPORTBACK',
 'odometer': 84576,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-03',
 'seller_name': 'Auction Plus',
 'title': 'AUDI A3 SPORTBACK 1.0 TFSI Sport 5dr',
 'transmission': 'manual',
 'trim': '1.0 TFSI Sport 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117135963%27 HTTP/1.1" 200 None
2025-12-04 19:00:52 [astonbarclay.gb] INFO: Saving data for 117135963: {'auction_closing_time': 1764936000.0, 'created_time': 1763060478.532667, 'last_price_update_time': 1764874852.661477}
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117135963') HTTP/1.1" 204 0
2025-12-04 19:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1df93c93-9009-58ed-97f8-28f83032e1a3 with identifier: 117459934
2025-12-04 19:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1df93c93-9009-58ed-97f8-28f83032e1a3 with identifier: 117459934
2025-12-04 19:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1df93c93-9009-58ed-97f8-28f83032e1a3 with identifier: 117459934 to the API
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117459934?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1df93c93-9009-58ed-97f8-28f83032e1a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS20JYL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117459934',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS SALOON',
 'odometer': 23315,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-12',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ A CLASS SALOON A180 AMG Line Executive 4dr Auto',
 'transmission': 'automatic',
 'trim': 'A180 AMG Line Executive 4dr Auto',
 'vin': None,
 'year': 2020}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459934%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Saving data for 117459934: {'auction_closing_time': 1765188000.0, 'created_time': 1764184269.026913, 'last_price_update_time': 1764874853.024932}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459934') HTTP/1.1" 204 0
2025-12-04 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117568753
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117568753: 2
2025-12-04 19:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114036273?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117632563
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117632563: 2
2025-12-04 19:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117605293, 'registration': 'KM69HWX', 'account': 'ALL016', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 53816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/24 38K', 'remarks': 'VOSA STATES  26K - 27K- 38K - 51K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/675faab8-ad82-4d69-8aed-2439c41c0a5a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117605293, 'registration': 'KM69HWX', 'account': 'ALL016', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 53816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KM69HWX/2025-12-02/image/aa300758-0cf0-438c-b1b4-992c5abb680b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/3b937082-aa30-4679-8229-d3a5d8708729_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/681c7d2a-0bb5-4982-a952-c6e2a02e48de_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/8a2e4109-4e92-47fa-9d29-a799f17a2344_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/e95a8559-82e9-4080-923f-469729c82f87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/b20ac89f-95fa-4841-af3b-d01c38c5e5f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/4f6110e0-7dde-48f9-836c-18f2c6fe3dea_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/d1532de9-b48e-4bd4-9c41-284d2e40bea2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM69HWX/2025-12-02/image/91a6ecca-eb61-463c-bdbe-3018b9992a09_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/24 38K', 'remarks': 'VOSA STATES  26K - 27K- 38K - 51K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/675faab8-ad82-4d69-8aed-2439c41c0a5a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-04 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb2e0dc-63cf-5790-9da5-de91299ab615 with scrape type 2
2025-12-04 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb2e0dc-63cf-5790-9da5-de91299ab615 with scrape type 2
2025-12-04 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffb2e0dc-63cf-5790-9da5-de91299ab615, identifier: 117605293
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117615455, 'registration': 'LX66KUS', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 97397, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1259, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-14', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66KUS/2025-12-01/image/2cae6d08-e309-413c-9e5d-98217cfb870b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/12f3958e-9a9a-4876-be9b-18ba221164c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/e4a79cbf-9804-44cc-8e37-5c5f41359a41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/f7c344c8-93bc-4bb7-9013-c9b137434855_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/55da107a-b5df-43a1-9c44-7100d1a8ba9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/168dfbd4-2636-4dc7-81d9-336b31080610_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/2cf90871-f808-43f8-a038-d0fbd6ec0b29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/1955163c-88b4-4791-a9c3-6d5e3cee8d36_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/fe8e251d-16e0-453c-a45f-0a9c21b1081b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/17-8K, 07/18-20K, 09/20-46K', 'remarks': 'VOSA STATES - 69K, 78K, 85K, 93K - SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e9612cc9-adff-4105-8c6c-e1d2a119fa54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117615455, 'registration': 'LX66KUS', 'account': 'WBA003', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 97397, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1259, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-09-14', 'fuel': 'Petrol', 'motExpiry': '2026-08-08', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX66KUS/2025-12-01/image/2cae6d08-e309-413c-9e5d-98217cfb870b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/12f3958e-9a9a-4876-be9b-18ba221164c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/e4a79cbf-9804-44cc-8e37-5c5f41359a41_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/f7c344c8-93bc-4bb7-9013-c9b137434855_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/55da107a-b5df-43a1-9c44-7100d1a8ba9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/168dfbd4-2636-4dc7-81d9-336b31080610_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/2cf90871-f808-43f8-a038-d0fbd6ec0b29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/1955163c-88b4-4791-a9c3-6d5e3cee8d36_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX66KUS/2025-12-01/image/fe8e251d-16e0-453c-a45f-0a9c21b1081b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 08/17-8K, 07/18-20K, 09/20-46K', 'remarks': 'VOSA STATES - 69K, 78K, 85K, 93K - SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e9612cc9-adff-4105-8c6c-e1d2a119fa54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c92904a4-edf2-50fe-ae33-b0242c20b06e with identifier: 117615455
2025-12-04 19:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c92904a4-edf2-50fe-ae33-b0242c20b06e with scrape type 2
2025-12-04 19:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c92904a4-edf2-50fe-ae33-b0242c20b06e with scrape type 2
2025-12-04 19:00:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c92904a4-edf2-50fe-ae33-b0242c20b06e, identifier: 117615455
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117684407
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117684407%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117684407: 0
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117599337
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117599337: 2
2025-12-04 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-04 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293
2025-12-04 19:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ffb2e0dc-63cf-5790-9da5-de91299ab615 with identifier: 117605293 to the API
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117605293?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ffb2e0dc-63cf-5790-9da5-de91299ab615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KM69HWX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117605293',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 53816,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-30',
 'seller_name': 'SMC GROUP',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605293%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Saving data for 117605293: {'auction_closing_time': 1765188000.0, 'created_time': 1764702168.647471, 'last_price_update_time': 1764874853.611745}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117605293') HTTP/1.1" 204 0
2025-12-04 19:00:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c92904a4-edf2-50fe-ae33-b0242c20b06e with identifier: 117615455
2025-12-04 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c92904a4-edf2-50fe-ae33-b0242c20b06e with identifier: 117615455
2025-12-04 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 156744 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156744
2025-12-04 19:00:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: c92904a4-edf2-50fe-ae33-b0242c20b06e spider: astonbarclay.gb
2025-12-04 19:00:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c92904a4-edf2-50fe-ae33-b0242c20b06e due to rule: high_mileage_for_country.json, error: 156744 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    156744
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'c92904a4-edf2-50fe-ae33-b0242c20b06e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX66KUS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117615455',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 97397,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': 'UKCGR - Select',
 'title': 'NISSAN JUKE HATCHBACK 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615455%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Saving data for 117615455: {'auction_closing_time': 1765215000.0, 'created_time': 1764442887.123112, 'last_price_update_time': 1764874853.894023}
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117615455') HTTP/1.1" 204 0
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Found listing with ID: 117184599
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-12-04 19:00:53 [astonbarclay.gb] INFO: Scrape type for 117184599: 2
2025-12-04 19:00:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:00:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:00:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:00:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6d24b10>
2025-12-04 19:00:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:00:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600 saved to cache
2025-12-04 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:00:54 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 114036273, 'registration': 'SC16YKU', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 71819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16YKU/2025-07-21/image/c7ff638c-2008-4f4e-9d76-063939cfd7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/db260a8c-951b-4a7a-a126-f37b07d3f6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/ef4e31fa-f1ec-4184-9a70-ca552c12d33a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ec7e89b-f19f-46c7-a464-4e9c71fbb515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/31548f0b-9dc0-49ff-b530-31649015c52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ad72bb1-86a0-4511-bcf9-af67bdb75400_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/bb6d51a7-4b02-4360-96a3-379438a72639_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/38575eee-ed64-4860-886f-172ebbcdb445_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'ONLY NEW KEEPERS SLIP IN OFFICE VOSA STATES 45K, 54K, 62K, 68K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8500a7-64a4-4c6f-9f20-d5c6dd3f7bc9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:54 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 114036273, 'registration': 'SC16YKU', 'account': 'ZUT001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 71819, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-27', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SC16YKU/2025-07-21/image/c7ff638c-2008-4f4e-9d76-063939cfd7fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/db260a8c-951b-4a7a-a126-f37b07d3f6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/ef4e31fa-f1ec-4184-9a70-ca552c12d33a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ec7e89b-f19f-46c7-a464-4e9c71fbb515_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/31548f0b-9dc0-49ff-b530-31649015c52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/5ad72bb1-86a0-4511-bcf9-af67bdb75400_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/bb6d51a7-4b02-4360-96a3-379438a72639_removebg.jpg?w=600', 'https://abimg003.imgix.net/SC16YKU/2025-07-21/image/38575eee-ed64-4860-886f-172ebbcdb445_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'ONLY NEW KEEPERS SLIP IN OFFICE VOSA STATES 45K, 54K, 62K, 68K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd8500a7-64a4-4c6f-9f20-d5c6dd3f7bc9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-04 19:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cfb3114-2738-53c3-a759-96c1d95b095f with scrape type 2
2025-12-04 19:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cfb3114-2738-53c3-a759-96c1d95b095f with scrape type 2
2025-12-04 19:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0cfb3114-2738-53c3-a759-96c1d95b095f, identifier: 114036273
2025-12-04 19:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-04 19:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273
2025-12-04 19:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0cfb3114-2738-53c3-a759-96c1d95b095f with identifier: 114036273 to the API
2025-12-04 19:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114036273?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0cfb3114-2738-53c3-a759-96c1d95b095f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SC16YKU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114036273',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 71819,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-27',
 'seller_name': 'Zuto',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114036273%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Saving data for 114036273: {'auction_closing_time': 1764936000.0, 'created_time': 1764097461.879199, 'last_price_update_time': 1764874855.531497}
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114036273') HTTP/1.1" 204 0
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117425377
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117425377: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117702288
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702288%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117702288: 1
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117498468
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117498468: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117688144
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688144%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117688144: 1
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117515973
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117515973: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117452123
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117452123: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117570049
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570049%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117570049: 0
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117455255
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117455255: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117217399
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117217399: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117023522
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117023522: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117498519
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498519%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117498519: 0
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117662789
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662789%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117662789: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117121221
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117121221: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117073655
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117073655: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117480843
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480843%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117480843: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117569819
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117569819: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117276677
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117276677: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117079065
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117079065: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117539813
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117539813: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 116509919
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 116509919: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117030784
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117030784: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117452490
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117452490: 2
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117700643
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700643%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117700643: 1
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117570719
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570719%27 HTTP/1.1" 200 None
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Scrape type for 117570719: 0
2025-12-04 19:00:55 [astonbarclay.gb] INFO: Found listing with ID: 117580077
2025-12-04 19:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580077%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117580077: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116928605
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928605%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116928605: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116928625
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116928625%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116928625: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117601685
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601685%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117601685: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117598232
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598232%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117598232: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117271901
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271901%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117271901: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117605544
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605544%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117605544: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117405887
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117405887%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117405887: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117188762
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117188762%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117188762: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116988436
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988436%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116988436: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117049908
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117049908%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117049908: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117101013
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117101013%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117101013: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117422764
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117422764%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117422764: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117238218
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117238218%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117238218: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116831329
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116831329%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116831329: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116804294
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116804294%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116804294: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116788960
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116788960%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116788960: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117447500
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117447500%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117447500: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117544347
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117544347%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117544347: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117623725
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623725%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117623725: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117661968
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661968%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117661968: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116800442
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116800442%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116800442: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117672698
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672698%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117672698: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117517475
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517475%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117517475: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117600062
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600062%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117600062: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117459952
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117459952: 2
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117756660
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117756660%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117756660: 1
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117240480?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117421533?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117623566
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623566%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117623566: 2
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117700684
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700684%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117700684: 1
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117663579
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117663579%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117663579: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117144960
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117144960: 2
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 116617318
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 116617318: 2
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117070544
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117070544%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117070544: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117553459
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117553459%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117553459: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117507922
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507922%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117507922: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117267875
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267875%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117267875: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117213849
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213849%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117213849: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117419626
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117419626%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117419626: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117725492
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117725492%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117725492: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117548959
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548959%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117548959: 1
2025-12-04 19:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117406735?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117459104
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459104%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117459104: 0
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Found listing with ID: 117740877
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740877%27 HTTP/1.1" 200 None
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Scrape type for 117740877: 1
2025-12-04 19:00:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117240480, 'registration': 'BD66VEK', 'account': 'MAN027', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr Powershift', 'mileage': 50129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-10-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD66VEK/2025-11-17/image/27d7db91-17c3-4ae1-b027-e093b8d469b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/eb1b5040-a02c-4675-98e4-54d7d9fbb808_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/500f59a1-6fcd-43a1-85ec-e71171f580e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/3ca7219e-fb32-49c7-8560-866b25a13053_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/a3d62489-017d-4e7a-aa08-227a152df0d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/0a8daba0-9627-4813-a2f3-44afbc02c231_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/00c58e50-704c-41e6-bc91-e56da8cfa08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/1ab91da0-3719-45f1-b2b3-00716f420898_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES  - 21K, 25K, 36K, 46K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec6c2fab-28a5-4a99-947a-51bcd2179a35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117240480, 'registration': 'BD66VEK', 'account': 'MAN027', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Zetec 5dr Powershift', 'mileage': 50129, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-10-06', 'fuel': 'Petrol', 'motExpiry': '2026-09-30', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BD66VEK/2025-11-17/image/27d7db91-17c3-4ae1-b027-e093b8d469b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/eb1b5040-a02c-4675-98e4-54d7d9fbb808_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/500f59a1-6fcd-43a1-85ec-e71171f580e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/3ca7219e-fb32-49c7-8560-866b25a13053_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/a3d62489-017d-4e7a-aa08-227a152df0d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/0a8daba0-9627-4813-a2f3-44afbc02c231_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/00c58e50-704c-41e6-bc91-e56da8cfa08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD66VEK/2025-11-17/image/1ab91da0-3719-45f1-b2b3-00716f420898_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES  - 21K, 25K, 36K, 46K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ec6c2fab-28a5-4a99-947a-51bcd2179a35.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with identifier: 117240480
2025-12-04 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with scrape type 2
2025-12-04 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with scrape type 2
2025-12-04 19:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b, identifier: 117240480
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117421533, 'registration': 'SJ16VYP', 'account': 'MAN037', 'make': 'TOYOTA', 'model': 'VERSO ESTATE', 'derivative': '1.6 V-matic Icon 5dr', 'mileage': 70345, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-13', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/8d739e29-df5b-4556-b26b-584384ad8344_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/3bceab4f-9a09-4dd4-9d61-c296e0192166_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d5dd2f0f-950c-4c2f-a679-cea20776587f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/670d8f56-0d80-4568-85a2-b07820f5f671_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/c97d6156-7195-42b3-ba50-2cbc5a3571e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/e45789ca-15b3-4b89-a0bb-412700d9bfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d3263473-04ea-481c-af37-b4bf03833f02_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 04/17 18K - 04/18 24K - 04/19 30K - 06/20 38K - 05/21 42K - 05/22 46K - 05/23 53K - 05/23 60K - 05/24 ??05/25 ??', 'remarks': 'VOSA STATES 42K- 48K - 53K - 60K - 67K -  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9470baae-37af-440a-a48c-ee05af6560aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117421533, 'registration': 'SJ16VYP', 'account': 'MAN037', 'make': 'TOYOTA', 'model': 'VERSO ESTATE', 'derivative': '1.6 V-matic Icon 5dr', 'mileage': 70345, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-04-13', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1596, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/8d739e29-df5b-4556-b26b-584384ad8344_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/3bceab4f-9a09-4dd4-9d61-c296e0192166_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d5dd2f0f-950c-4c2f-a679-cea20776587f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/670d8f56-0d80-4568-85a2-b07820f5f671_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/c97d6156-7195-42b3-ba50-2cbc5a3571e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/e45789ca-15b3-4b89-a0bb-412700d9bfcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ16VYP/2025-11-21/image/d3263473-04ea-481c-af37-b4bf03833f02_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 04/17 18K - 04/18 24K - 04/19 30K - 06/20 38K - 05/21 42K - 05/22 46K - 05/23 53K - 05/23 60K - 05/24 ??05/25 ??', 'remarks': 'VOSA STATES 42K- 48K - 53K - 60K - 67K -  SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9470baae-37af-440a-a48c-ee05af6560aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-04 19:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c19369b-b993-5a83-b20d-1521432bf963 with scrape type 2
2025-12-04 19:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c19369b-b993-5a83-b20d-1521432bf963 with scrape type 2
2025-12-04 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6c19369b-b993-5a83-b20d-1521432bf963, identifier: 117421533
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117767385, 'registration': 'AP66CFJ', 'account': 'MAN037', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 S 3dr', 'mileage': 64548, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-12-22', 'fuel': 'Petrol', 'motExpiry': '2025-11-13', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/acb6e3f5-77d5-4da3-8d56-9fd75c8d6efd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117767385, 'registration': 'AP66CFJ', 'account': 'MAN037', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 S 3dr', 'mileage': 64548, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-12-22', 'fuel': 'Petrol', 'motExpiry': '2025-11-13', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/acb6e3f5-77d5-4da3-8d56-9fd75c8d6efd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 988e0459-29b3-5254-a7c7-c09dd15de559 with identifier: 117767385
2025-12-04 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988e0459-29b3-5254-a7c7-c09dd15de559 with scrape type 1
2025-12-04 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F0317816d-9635-4781-b497-761fbc755a99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117310723, 'registration': 'RV66XCX', 'account': 'DAN036', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav]', 'mileage': 51449, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-22', 'fuel': 'Petrol', 'motExpiry': '2026-10-08', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RV66XCX/2025-11-18/image/fac241cc-cd1e-4326-ae37-1e4752bf270d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/2c96102c-43f7-4f00-879c-4df44221ce0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/c0bb5dde-1c39-410a-b3aa-b6b4a6c2a449_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/0bae5347-7c0f-4b80-be05-1358c4ddeb75_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/4264a0de-0a27-40c3-b483-f6826872751d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/48720d7f-d38e-4ab0-a768-ac72b358f0fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RV66XCX/2025-11-18/image/21e5f7f0-1074-4bfc-801c-483f61bcb771_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES - 26K, 37K, 49K, 51K', 'virtual': False, 'seller': 'Local dealer group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a8c212ee-b852-4f40-b03c-a78097b53574.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-04 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-12-04 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with scrape type 2
2025-12-04 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3e5c1793-1592-51ac-94a1-fc485e5e64b0, identifier: 117310723
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117311708, 'registration': 'LP69DMZ', 'account': 'MAN037', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI EVO Match Edition 5dr', 'mileage': 93096, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2020-01-20', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/a6843e07-c65b-4401-98c2-5f2271061044_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/0ec9d7ca-606f-4e93-b123-a89237bf5897_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/5939a1fc-290f-44a5-a2a1-ecae5e89b94e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/726b4923-419f-4f38-9155-f995c2259f92_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/d60cbfed-797e-4fcc-acee-e00ecdc60d60_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b9ca54e6-9f0f-4b3f-8847-213bf32e232c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/b765dc8b-f8af-4847-ab12-9d441b98434e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP69DMZ/2025-11-19/image/91dd433f-f5d1-4aa7-83d2-43ee144274ba_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 028/20 17K - 02/21 29K - 05/21 36K - 12/22 77K- 08/23 82K 08/24 86K 08/25 91K', 'remarks': 'VOSA STATES 77K- 83K- 87K - 92K SD CARD IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/86461ec9-65eb-4cc8-9d9a-43dc6990f4fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-04 19:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-12-04 19:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 350707ad-cc6c-53bb-87b0-159f6e20ee05 with scrape type 2
2025-12-04 19:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 350707ad-cc6c-53bb-87b0-159f6e20ee05, identifier: 117311708
2025-12-04 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with identifier: 117240480
2025-12-04 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with identifier: 117240480
2025-12-04 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b with identifier: 117240480 to the API
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117240480?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '70c2e56a-5d5a-543a-b5d2-f5f6a2fb9e8b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD66VEK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117240480',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 50129,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-06',
 'seller_name': 'Mann Island Finance',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Zetec 5dr Powershift',
 'transmission': 'automatic',
 'trim': '1.0 EcoBoost Zetec 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240480%27 HTTP/1.1" 200 None
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Saving data for 117240480: {'auction_closing_time': 1765215000.0, 'created_time': 1764407009.334774, 'last_price_update_time': 1764874857.54536}
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117240480') HTTP/1.1" 204 0
2025-12-04 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-04 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533
2025-12-04 19:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6c19369b-b993-5a83-b20d-1521432bf963 with identifier: 117421533 to the API
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117421533?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '6c19369b-b993-5a83-b20d-1521432bf963',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SJ16VYP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117421533',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'VERSO ESTATE',
 'odometer': 70345,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-13',
 'seller_name': 'Manamanx Ltd',
 'title': 'TOYOTA VERSO ESTATE 1.6 V-matic Icon 5dr',
 'transmission': 'manual',
 'trim': '1.6 V-matic Icon 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421533%27 HTTP/1.1" 200 None
2025-12-04 19:00:57 [astonbarclay.gb] INFO: Saving data for 117421533: {'auction_closing_time': 1765215000.0, 'created_time': 1763751904.036755, 'last_price_update_time': 1764874857.945649}
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117421533') HTTP/1.1" 204 0
2025-12-04 19:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-04 19:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723
2025-12-04 19:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3e5c1793-1592-51ac-94a1-fc485e5e64b0 with identifier: 117310723 to the API
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117310723?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3e5c1793-1592-51ac-94a1-fc485e5e64b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RV66XCX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117310723',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 51449,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-22',
 'seller_name': 'Local dealer group',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310723%27 HTTP/1.1" 200 None
2025-12-04 19:00:58 [astonbarclay.gb] INFO: Saving data for 117310723: {'auction_closing_time': 1764936000.0, 'created_time': 1763492732.772906, 'last_price_update_time': 1764874858.950582}
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117310723') HTTP/1.1" 204 0
2025-12-04 19:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-04 19:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708
2025-12-04 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 350707ad-cc6c-53bb-87b0-159f6e20ee05 with identifier: 117311708 to the API
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27350707ad-cc6c-53bb-87b0-159f6e20ee05%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 350707ad-cc6c-53bb-87b0-159f6e20ee05: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:00:58 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117311708?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '350707ad-cc6c-53bb-87b0-159f6e20ee05',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP69DMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117311708',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 93096,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-20',
 'seller_name': 'Manamanx Ltd',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI EVO Match Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO Match Edition 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117311708%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Saving data for 117311708: {'auction_closing_time': 1765215000.0, 'created_time': 1763492766.250229, 'last_price_update_time': 1764874859.251162}
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117311708') HTTP/1.1" 204 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117743414
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743414%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117743414: 1
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252Fdeba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117753214
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117753214%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117753214: 1
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252Ff992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:00:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117406735, 'registration': 'DK16BXM', 'account': 'CAR001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr Step Auto', 'mileage': 81543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-20', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK16BXM/2025-11-21/image/f7a5aefe-4496-42c8-8a36-e6243d29ddbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/5a258935-69ff-4108-a75e-21083b1c5c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/c7bbf55c-0cb5-459b-be92-7d55dcfd4e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/8911d60e-ec99-4264-80ce-540fa42c29a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/07f72ca0-6004-4882-af18-37d69e61bab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/950fe958-42cf-49f0-be0b-9ff5d96a71ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/2d6adde8-deee-407a-811f-379b8e86b133_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/e8a01760-7a23-46b6-b48e-8b25d4cab7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/fee8f971-15a5-47c5-ae39-d5a5f48cf87d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 63K, 71K, 78K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d368223-2595-49b9-98f1-c5ec906a0d6f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117406735, 'registration': 'DK16BXM', 'account': 'CAR001', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '218i Luxury 5dr Step Auto', 'mileage': 81543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-20', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DK16BXM/2025-11-21/image/f7a5aefe-4496-42c8-8a36-e6243d29ddbf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/5a258935-69ff-4108-a75e-21083b1c5c5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/c7bbf55c-0cb5-459b-be92-7d55dcfd4e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/8911d60e-ec99-4264-80ce-540fa42c29a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/07f72ca0-6004-4882-af18-37d69e61bab9_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/950fe958-42cf-49f0-be0b-9ff5d96a71ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/2d6adde8-deee-407a-811f-379b8e86b133_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/e8a01760-7a23-46b6-b48e-8b25d4cab7d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DK16BXM/2025-11-21/image/fee8f971-15a5-47c5-ae39-d5a5f48cf87d_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 63K, 71K, 78K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d368223-2595-49b9-98f1-c5ec906a0d6f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-04 19:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 529969d9-5cef-5593-9a35-65d0939c0d15 with scrape type 2
2025-12-04 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 529969d9-5cef-5593-9a35-65d0939c0d15 with scrape type 2
2025-12-04 19:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 529969d9-5cef-5593-9a35-65d0939c0d15, identifier: 117406735
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117719094
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719094%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117719094: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117345378
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117345378%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117345378: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117606946
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117606946%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117606946: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117449793
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117449793%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117449793: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117666809
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117666809%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117666809: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117471399
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117471399: 2
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-04 19:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735
2025-12-04 19:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 529969d9-5cef-5593-9a35-65d0939c0d15 with identifier: 117406735 to the API
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117406735?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '529969d9-5cef-5593-9a35-65d0939c0d15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DK16BXM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117406735',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES GRAN TOURER',
 'odometer': 81543,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-01',
 'seller_name': 'CarGiant',
 'title': 'BMW 2 SERIES GRAN TOURER 218i Luxury 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '218i Luxury 5dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406735%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Saving data for 117406735: {'auction_closing_time': 1764936000.0, 'created_time': 1763751905.582027, 'last_price_update_time': 1764874859.9079}
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117406735') HTTP/1.1" 204 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117563844
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563844%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117563844: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117672666
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672666%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117672666: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117745603
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117745603%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117745603: 0
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Found listing with ID: 117705864
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705864%27 HTTP/1.1" 200 None
2025-12-04 19:00:59 [astonbarclay.gb] INFO: Scrape type for 117705864: 2
2025-12-04 19:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023546?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117002721, 'registration': 'HT19ODX', 'account': 'AST003', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE Iconic 5dr', 'mileage': 66282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-03-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-21', 'doors': 5, 'engineSize': 1330, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HT19ODX/2025-11-12/image/44964eec-e4aa-4b80-aa15-61f416130649_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/40abfd10-cb75-42f7-a08d-b0ef032a35df_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/dc6660f0-875c-4fe8-becc-32ef9fe29749_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/26089d6e-ec0b-41a0-85ab-d873e2a7584c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/b0bfd98c-9df5-4b2a-927c-aa46691d5bd1_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/38b4cbfe-c4e5-4158-b789-72352a9a5efb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/7bc0a75e-3436-4b6c-a3e9-4a1537897680_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/cdcc65c6-9647-4e07-af4b-4da74194aa5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HT19ODX/2025-11-12/image/c8d6436d-822f-4390-91d8-ade87ccd6914_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20- 18K, 02/21- 26K', 'remarks': 'VOSA STATES 46K, 59K, DAMAGED SPARE KEY IN', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d0471923-74fa-44fe-b531-63906c03feb4.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-04 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 2
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb4712bc-835e-5d1b-8a87-785ebf261f12 with scrape type 2
2025-12-04 19:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb4712bc-835e-5d1b-8a87-785ebf261f12, identifier: 117002721
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117634236, 'registration': 'BD16ATV', 'account': 'THE109', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI CR Scout 4x4 5dr', 'mileage': 135220, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-05', 'fuel': 'Diesel', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5b75d10e-5672-456f-a08f-c019307a3294.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117634236, 'registration': 'BD16ATV', 'account': 'THE109', 'make': 'SKODA', 'model': 'OCTAVIA DIESEL ESTATE', 'derivative': '2.0 TDI CR Scout 4x4 5dr', 'mileage': 135220, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-05-05', 'fuel': 'Diesel', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5b75d10e-5672-456f-a08f-c019307a3294.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 with identifier: 117634236
2025-12-04 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 with scrape type 1
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-04 19:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721
2025-12-04 19:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb4712bc-835e-5d1b-8a87-785ebf261f12 with identifier: 117002721 to the API
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117002721?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'eb4712bc-835e-5d1b-8a87-785ebf261f12',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HT19ODX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117002721',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 66282,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-28',
 'seller_name': 'TCB Group - Value',
 'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE Iconic 5dr',
 'transmission': 'manual',
 'trim': '1.3 TCE Iconic 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117002721%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Saving data for 117002721: {'auction_closing_time': 1764936000.0, 'created_time': 1764615687.27575, 'last_price_update_time': 1764874860.542801}
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117002721') HTTP/1.1" 204 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117638131
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117638131%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117638131: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117563937
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563937%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117563937: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117563927
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563927%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117563927: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117099385
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117099385%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117099385: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117563903
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563903%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117563903: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117605936
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605936%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117605936: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117605946
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117605946%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117605946: 0
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117323884
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117323884: 2
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116321191?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117267405?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498427?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Found listing with ID: 117374356
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Scrape type for 117374356: 2
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fcc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117023546, 'registration': 'DG21HWN', 'account': 'LPK001', 'make': 'SEAT', 'model': 'CUPRA LEON ESTATE SPECIAL EDITION', 'derivative': '1.4 eHybrid First Edition 5dr DSG', 'mileage': 64765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-04-05', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d597466d-8aeb-404b-9934-4b0cfc9d332f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d02c463c-2398-44b4-89e9-c991dcf73531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/5e4ad193-fa91-492e-afd1-8a620a2e0352_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8713f9d6-d626-48e8-a19b-c32c824b8552_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/68ec5301-7f7a-4c40-872b-481348fd94ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/88eba719-c70d-4753-8d26-796fca600677_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/a6ff1d3e-3a66-4a5d-a452-772ea6a7fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/59d7ff2d-1f53-496c-9e27-be9d962863d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/0288890e-bb37-4d4f-977c-0678641ee100_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8e8cbfeb-fcaf-4df6-b6a9-2429d0c8c304_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/ff469265-fea9-446c-b18f-1750b482e395_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80682b1f-279f-4852-a39e-e03204e6326f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117023546, 'registration': 'DG21HWN', 'account': 'LPK001', 'make': 'SEAT', 'model': 'CUPRA LEON ESTATE SPECIAL EDITION', 'derivative': '1.4 eHybrid First Edition 5dr DSG', 'mileage': 64765, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-04-06', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-04-05', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d597466d-8aeb-404b-9934-4b0cfc9d332f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/d02c463c-2398-44b4-89e9-c991dcf73531_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/5e4ad193-fa91-492e-afd1-8a620a2e0352_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8713f9d6-d626-48e8-a19b-c32c824b8552_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/68ec5301-7f7a-4c40-872b-481348fd94ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/88eba719-c70d-4753-8d26-796fca600677_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/a6ff1d3e-3a66-4a5d-a452-772ea6a7fd83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/59d7ff2d-1f53-496c-9e27-be9d962863d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/0288890e-bb37-4d4f-977c-0678641ee100_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/8e8cbfeb-fcaf-4df6-b6a9-2429d0c8c304_removebg.jpg?w=600', 'https://abimg003.imgix.net/DG21HWN/2025-11-11/image/ff469265-fea9-446c-b18f-1750b482e395_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 60K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 31, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80682b1f-279f-4852-a39e-e03204e6326f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-12-04 19:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a880db-d936-518f-9f7b-3c299ca85e13 with scrape type 2
2025-12-04 19:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a880db-d936-518f-9f7b-3c299ca85e13 with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08a880db-d936-518f-9f7b-3c299ca85e13, identifier: 117023546
2025-12-04 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117357391?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-12-04 19:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546
2025-12-04 19:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 08a880db-d936-518f-9f7b-3c299ca85e13 with identifier: 117023546 to the API
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2708a880db-d936-518f-9f7b-3c299ca85e13%27 HTTP/1.1" 200 None
2025-12-04 19:01:01 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 08a880db-d936-518f-9f7b-3c299ca85e13: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:00 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117023546?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 31,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '08a880db-d936-518f-9f7b-3c299ca85e13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DG21HWN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023546',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'CUPRA LEON ESTATE SPECIAL EDITION',
 'odometer': 64765,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-04-06',
 'seller_name': 'Auction Plus',
 'title': 'SEAT CUPRA LEON ESTATE SPECIAL EDITION 1.4 eHybrid First Edition '
          '5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid First Edition 5dr DSG',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023546%27 HTTP/1.1" 200 None
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Saving data for 117023546: {'auction_closing_time': 1764936000.0, 'created_time': 1762844451.959818, 'last_price_update_time': 1764874861.287971}
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023546') HTTP/1.1" 204 0
2025-12-04 19:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117736341
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117736341%27 HTTP/1.1" 200 None
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117736341: 0
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Found listing with ID: 117573049
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Scrape type for 117573049: 2
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b4d450>
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252Fdeba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116321191, 'registration': 'LX67OHF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67410, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2025-10-13/image/1c7cd0f4-33f8-4c88-8a4a-91d937a7e941_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c016f6-99f5-4abe-bc7f-7b56370305b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e5636665-c183-4062-9f82-6ae981bf6c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c2cf61-ddf2-43fc-b860-881462473eea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/7fc7e5e3-1af3-4ed6-a5df-bf53326ceec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/b2acc92d-75b8-4147-995c-6fb9f3d5b8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e466c6a1-4d88-4847-a65b-2c4bc304921f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/244497cc-daab-4d2c-9f14-7e6778570fb8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print and book 10/18 9K - 09/19 20K - 05/25 63K', 'remarks': 'VOSA STATES 39K - 48K - 55K- 66K - SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4230553-9a9e-4e45-9181-443571c2fe9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116321191, 'registration': 'LX67OHF', 'account': 'CAR001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr', 'mileage': 67410, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-08-27', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LX67OHF/2025-10-13/image/1c7cd0f4-33f8-4c88-8a4a-91d937a7e941_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c016f6-99f5-4abe-bc7f-7b56370305b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e5636665-c183-4062-9f82-6ae981bf6c43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/92c2cf61-ddf2-43fc-b860-881462473eea_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/7fc7e5e3-1af3-4ed6-a5df-bf53326ceec0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/b2acc92d-75b8-4147-995c-6fb9f3d5b8f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/e466c6a1-4d88-4847-a65b-2c4bc304921f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LX67OHF/2025-10-13/image/244497cc-daab-4d2c-9f14-7e6778570fb8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print and book 10/18 9K - 09/19 20K - 05/25 63K', 'remarks': 'VOSA STATES 39K - 48K - 55K- 66K - SPARE KEY IN OFFICE - SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a4230553-9a9e-4e45-9181-443571c2fe9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-04 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6ac21a38-f398-5169-b45f-470ca282fee2 with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6ac21a38-f398-5169-b45f-470ca282fee2 with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6ac21a38-f398-5169-b45f-470ca282fee2, identifier: 116321191
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117267405, 'registration': 'RY18ADO', 'account': 'BET001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line X 5dr 2WD', 'mileage': 79965, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RY18ADO/2025-11-19/image/3b63ae5d-0109-410d-ab6b-befeac662640_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/45a88fa0-536e-4b67-863f-7f149ccdfeb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ba9b13d2-5ad9-43d8-8040-1ceec3c626ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/1addc2f9-b8bb-442b-946e-41c0c4eb30f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ccf57e4b-4cc2-4e96-aeb8-cde43c81a9d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/9487293e-d751-4317-9327-6b12d905eeb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ad4d5ce4-360d-4b29-89a4-48ab78cbfd89_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/a3be5a7a-d61b-470d-a486-6de4b9d5686b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/be126ab9-9966-4f6c-b939-a45d01f596be_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/c966e136-fe3a-481d-b572-9ede9c8a13f0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/19 11K - 05/20 17K - 05/21 23K - 05/22 32K - 09/22 36K  07/23 49K - 06/24 66K - 09/25 79K', 'remarks': 'FRONT PAGE OF V5 ONLY - VOSA STATES 36K- 53K- 68K - 79K -', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cd9a0c8-31f7-40c1-8d4e-c96c931121de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117267405, 'registration': 'RY18ADO', 'account': 'BET001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost ST-Line X 5dr 2WD', 'mileage': 79965, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-09-27', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/RY18ADO/2025-11-19/image/3b63ae5d-0109-410d-ab6b-befeac662640_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/45a88fa0-536e-4b67-863f-7f149ccdfeb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ba9b13d2-5ad9-43d8-8040-1ceec3c626ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/1addc2f9-b8bb-442b-946e-41c0c4eb30f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ccf57e4b-4cc2-4e96-aeb8-cde43c81a9d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/9487293e-d751-4317-9327-6b12d905eeb9_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/ad4d5ce4-360d-4b29-89a4-48ab78cbfd89_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/a3be5a7a-d61b-470d-a486-6de4b9d5686b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/be126ab9-9966-4f6c-b939-a45d01f596be_removebg.jpg?w=600', 'https://abimg003.imgix.net/RY18ADO/2025-11-19/image/c966e136-fe3a-481d-b572-9ede9c8a13f0_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 06/19 11K - 05/20 17K - 05/21 23K - 05/22 32K - 09/22 36K  07/23 49K - 06/24 66K - 09/25 79K', 'remarks': 'FRONT PAGE OF V5 ONLY - VOSA STATES 36K- 53K- 68K - 79K -', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cd9a0c8-31f7-40c1-8d4e-c96c931121de.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89225a07-bbf2-597f-b50f-0126c839c5ee with identifier: 117267405
2025-12-04 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89225a07-bbf2-597f-b50f-0126c839c5ee with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89225a07-bbf2-597f-b50f-0126c839c5ee with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 89225a07-bbf2-597f-b50f-0126c839c5ee, identifier: 117267405
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117498427, 'registration': 'KP66OTZ', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 78302, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-10', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/431e4a43-ed8b-4338-8c4e-e89b7628f8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/cff74451-36a2-4c96-a000-930264c2d943_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/118fbde7-40a7-46c8-b876-3597a3198386_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8a68b093-06db-4acb-ad1d-a52741b25f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8dca468f-dc48-4e1e-a25b-bc8bfde7be96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/73b46e2e-3448-4bed-b428-519d31bb2f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/01410eb1-f124-4a68-86ef-73a2bbfcb4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/7e2e0ac5-75c0-483c-9d5c-0bb6b55c24f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/b97bfd61-d442-4d4a-8b36-99e54cd974ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8d900a60-0bc0-4f5f-a965-f71fee3cdbad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18-15K 03/19-18K 09/19-20K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 42K 55K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c8a8d5a-3de3-469f-af99-4786d5c80fb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117498427, 'registration': 'KP66OTZ', 'account': 'CAR001', 'make': 'BMW', 'model': '3 SERIES SALOON', 'derivative': '330e SE 4dr Step Auto', 'mileage': 78302, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-09-28', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-04-10', 'doors': 4, 'engineSize': 1998, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/431e4a43-ed8b-4338-8c4e-e89b7628f8e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/cff74451-36a2-4c96-a000-930264c2d943_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/118fbde7-40a7-46c8-b876-3597a3198386_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8a68b093-06db-4acb-ad1d-a52741b25f67_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8dca468f-dc48-4e1e-a25b-bc8bfde7be96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/73b46e2e-3448-4bed-b428-519d31bb2f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/01410eb1-f124-4a68-86ef-73a2bbfcb4cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/7e2e0ac5-75c0-483c-9d5c-0bb6b55c24f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/b97bfd61-d442-4d4a-8b36-99e54cd974ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KP66OTZ/2025-11-26/image/8d900a60-0bc0-4f5f-a965-f71fee3cdbad_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/18-15K 03/19-18K 09/19-20K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 30K 42K 55K 71K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 44, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8c8a8d5a-3de3-469f-af99-4786d5c80fb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-04 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3973878e-6dd9-5a78-95a8-f0cc5493e34f with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3973878e-6dd9-5a78-95a8-f0cc5493e34f with scrape type 2
2025-12-04 19:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3973878e-6dd9-5a78-95a8-f0cc5493e34f, identifier: 117498427
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117763955, 'registration': 'DU67FNV', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T Design Nav 5dr', 'mileage': 52560, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f712a9bb-499b-4785-b834-958a5e4416ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117763955, 'registration': 'DU67FNV', 'account': 'MAN037', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T Design Nav 5dr', 'mileage': 52560, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f712a9bb-499b-4785-b834-958a5e4416ea.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 223e29a2-63ad-5101-818d-a907cca65400 with identifier: 117763955
2025-12-04 19:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223e29a2-63ad-5101-818d-a907cca65400 with scrape type 1
2025-12-04 19:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fbb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:02 [astonbarclay.gb] INFO: Found listing with ID: 117374304
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [astonbarclay.gb] INFO: Scrape type for 117374304: 2
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Ff8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-04 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191
2025-12-04 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6ac21a38-f398-5169-b45f-470ca282fee2 with identifier: 116321191 to the API
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276ac21a38-f398-5169-b45f-470ca282fee2%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6ac21a38-f398-5169-b45f-470ca282fee2: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116321191?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '6ac21a38-f398-5169-b45f-470ca282fee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX67OHF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116321191',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 67410,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-20',
 'seller_name': 'CarGiant',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116321191%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [astonbarclay.gb] INFO: Saving data for 116321191: {'auction_closing_time': 1764936000.0, 'created_time': 1760382270.363496, 'last_price_update_time': 1764874862.335821}
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116321191') HTTP/1.1" 204 0
2025-12-04 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 89225a07-bbf2-597f-b50f-0126c839c5ee with identifier: 117267405
2025-12-04 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 89225a07-bbf2-597f-b50f-0126c839c5ee with identifier: 117267405
2025-12-04 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 89225a07-bbf2-597f-b50f-0126c839c5ee with identifier: 117267405 to the API
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117267405?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '89225a07-bbf2-597f-b50f-0126c839c5ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RY18ADO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117267405',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 79965,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-09',
 'seller_name': None,
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost ST-Line X 5dr 2WD',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost ST-Line X 5dr 2WD',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117267405%27 HTTP/1.1" 200 None
2025-12-04 19:01:02 [astonbarclay.gb] INFO: Saving data for 117267405: {'auction_closing_time': 1764936000.0, 'created_time': 1764184078.429743, 'last_price_update_time': 1764874862.742216}
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117267405') HTTP/1.1" 204 0
2025-12-04 19:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-04 19:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427
2025-12-04 19:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3973878e-6dd9-5a78-95a8-f0cc5493e34f with identifier: 117498427 to the API
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%273973878e-6dd9-5a78-95a8-f0cc5493e34f%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3973878e-6dd9-5a78-95a8-f0cc5493e34f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:02 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117498427?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 44,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '3973878e-6dd9-5a78-95a8-f0cc5493e34f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KP66OTZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498427',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES SALOON',
 'odometer': 78302,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-28',
 'seller_name': 'CarGiant',
 'title': 'BMW 3 SERIES SALOON 330e SE 4dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e SE 4dr Step Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498427%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Saving data for 117498427: {'auction_closing_time': 1764936000.0, 'created_time': 1764097433.168573, 'last_price_update_time': 1764874863.039956}
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498427') HTTP/1.1" 204 0
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117357391, 'registration': 'MD65ZGJ', 'account': 'ATA001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic', 'mileage': 114245, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2015-12-31', 'fuel': 'Diesel', 'motExpiry': '2025-10-18', 'doors': 4, 'engineSize': 2987, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/e75845a7-ff1e-4d8f-a5d3-1bc426c0f621_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/98787ba9-3b07-4f04-8695-ed791eec5b21_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/ef17cd06-8ac6-4c1c-aec0-987a18b6213d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/dbe961d9-9a4f-4b4b-93d8-58be6ec87e81_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/39883fdf-758a-4dd8-9db1-6a1fc9460963_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/acdf63f3-e504-41f5-89a9-3a188f05925a_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/20ce900a-7cd9-42d9-abff-27aa73e79582_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/80449f7a-12fc-425c-ba18-b693bf618e99_removebg.jpg?w=600', 'https://abimg003.imgix.net/MD65ZGJ/2025-11-19/image/97f3ef64-7d92-41bb-9c7d-806403c7c491_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/17 25K - 06/21 68K - 12/21 72K - 12/22 81K - 02/24 95K - 10/24 103K', 'remarks': 'VOSA STATES, 72K, 78K, 91K, 103K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6e05b61b-9d6e-4b66-877b-a23c2fee261c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-04 19:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9926db2-eb01-5575-baac-fcdfc0a1b314 with scrape type 2
2025-12-04 19:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f9926db2-eb01-5575-baac-fcdfc0a1b314, identifier: 117357391
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117425969
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117425969: 2
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fc28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117756660?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117022539?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-04 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f9926db2-eb01-5575-baac-fcdfc0a1b314 with identifier: 117357391
2025-12-04 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
2025-12-04 19:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f9926db2-eb01-5575-baac-fcdfc0a1b314 spider: astonbarclay.gb
2025-12-04 19:01:03 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f9926db2-eb01-5575-baac-fcdfc0a1b314 due to rule: high_mileage_for_country.json, error: 183859 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183859
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f9926db2-eb01-5575-baac-fcdfc0a1b314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MD65ZGJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117357391',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 114245,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-31',
 'seller_name': 'Auction Plus',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E350 BlueTEC AMG Night Ed '
          'Premium 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E350 BlueTEC AMG Night Ed Premium 4dr 9G-Tronic',
 'vin': None,
 'year': 2015}
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117357391%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Saving data for 117357391: {'auction_closing_time': 1764936000.0, 'created_time': 1763665371.217539, 'last_price_update_time': 1764874863.458897}
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117357391') HTTP/1.1" 204 0
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48842d0>
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:03 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117729380
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117729380%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117729380: 0
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Found listing with ID: 117747534
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117747534%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [astonbarclay.gb] INFO: Scrape type for 117747534: 1
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c3f090>
2025-12-04 19:01:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5be5d10>
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f1cdd0>
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117610912
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610912%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117610912: 0
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117361961
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117361961%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117361961: 0
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117563859
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117563859%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117563859: 0
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117672175
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672175%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117672175: 0
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Found listing with ID: 117543807
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Scrape type for 117543807: 2
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117700643?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117756660, 'registration': 'EX17JXE', 'account': 'MOT075', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 210 Titanium Sport 5dr Powershift', 'mileage': 108530, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/25 106K', 'remarks': 'SPARE KEY NUMBER OF FORMER KEEPERS UNKNOWN VOSA STATES 38K 57K 77K 89K 95K 101K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88191a12-4e89-4cad-b2fc-72f9634cfdfa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117756660, 'registration': 'EX17JXE', 'account': 'MOT075', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 210 Titanium Sport 5dr Powershift', 'mileage': 108530, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-14', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/25 106K', 'remarks': 'SPARE KEY NUMBER OF FORMER KEEPERS UNKNOWN VOSA STATES 38K 57K 77K 89K 95K 101K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88191a12-4e89-4cad-b2fc-72f9634cfdfa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c959656-de0e-5d45-bafe-9579832c71a0 with identifier: 117756660
2025-12-04 19:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c959656-de0e-5d45-bafe-9579832c71a0 with scrape type 1
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1c959656-de0e-5d45-bafe-9579832c71a0
2025-12-04 19:01:04 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1c959656-de0e-5d45-bafe-9579832c71a0
2025-12-04 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1c959656-de0e-5d45-bafe-9579832c71a0, identifier: 117756660
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'KCS003', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117568753, 'registration': 'DS67TJV', 'account': 'KCS003', 'make': 'MAZDA', 'model': 'CX-3 DIESEL HATCHBACK', 'derivative': '1.5d Sport Nav 5dr', 'mileage': 65256, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-12-06', 'fuel': 'Diesel', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS67TJV/2025-11-27/image/2b6b677b-089e-4073-9435-87261cf79d1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/8b037094-f2ba-415a-b30d-c4758ade43a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/d6133dd2-fc4c-48ca-a7a8-e3c37a4e223d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/5ee7686d-d22d-4d5d-9bd0-ebb8f0ba0d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/58e670c0-0e7b-4b5d-967f-76d2bc7a25de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/06d6078e-b24a-4071-afe8-6b388928e0a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/37879d21-f67d-4347-8393-60bb6f1fe119_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS67TJV/2025-11-27/image/c8aa32e1-8952-4c34-8940-0a0ccfaf57c3_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 43K- 54K- 62K - 65K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/97f2b055-c554-4e52-a866-b4d85df17c3e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-04 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 2
2025-12-04 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with scrape type 2
2025-12-04 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46, identifier: 117568753
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117022539, 'registration': 'NG68LXL', 'account': 'SID006', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK', 'derivative': '1.0 T3 GSE Longitude 5dr', 'mileage': 42928, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-17', 'fuel': 'Petrol', 'motExpiry': '2025-11-18', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NG68LXL/2025-11-12/image/b9f4ecea-2afd-4d57-977b-26ca3a590d0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/1c902a8f-308c-4d88-97de-506e77b165d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/4837c531-5d0c-4768-8cc1-fbc1567786d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/45e4475c-f521-4366-b35c-35bf345c87c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/d0b65324-7666-4fb2-ac6e-eeecc26fcc97_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/43ad81f9-9f6b-4ae0-b78e-511d54d5fb21_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/941d6a14-2647-4b5e-a08b-d0cde5c66799_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/f339ca05-a50f-4b01-b0c4-4338f185ade8_removebg.jpg?w=600', 'https://abimg003.imgix.net/NG68LXL/2025-11-12/image/c3d744a8-ca79-4165-a34f-a3d809035221_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/20 9K - 02/21 17K - 03/22 ??', 'remarks': "ODO SHOWS 69087 IN KM'S - VOSA DISCREPANCY, VOSA STATES, 24K, 22K, 35K, 41K - SPARE KEY IN OFFICE", 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cd18ac3-6da8-478c-9b2f-85cffd32ccdf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-04 19:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-12-04 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with scrape type 2
2025-12-04 19:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6, identifier: 117022539
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452490?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117030784?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1c959656-de0e-5d45-bafe-9579832c71a0 with identifier: 117756660
2025-12-04 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1c959656-de0e-5d45-bafe-9579832c71a0 with identifier: 117756660
2025-12-04 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 174661 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174661
2025-12-04 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1c959656-de0e-5d45-bafe-9579832c71a0 spider: astonbarclay.gb
2025-12-04 19:01:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1c959656-de0e-5d45-bafe-9579832c71a0 due to rule: high_mileage_for_country.json, error: 174661 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    174661
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1c959656-de0e-5d45-bafe-9579832c71a0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX17JXE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117756660',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'S-MAX DIESEL ESTATE',
 'odometer': 108530,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'MotoNovo Finance',
 'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 210 Titanium Sport 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 210 Titanium Sport 5dr Powershift',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117756660%27 HTTP/1.1" 200 None
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Saving data for 117756660: {'created_time': 1764874865.482263, 'last_price_update_time': 1764874865.482274, 'auction_closing_time': 1765274400.0}
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117756660') HTTP/1.1" 204 0
2025-12-04 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-04 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753
2025-12-04 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e2b6d930-d9f3-5dd0-8d98-f900c4b66f46 with identifier: 117568753 to the API
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117568753?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e2b6d930-d9f3-5dd0-8d98-f900c4b66f46',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS67TJV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117568753',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MAZDA',
 'model': 'CX-3 DIESEL HATCHBACK',
 'odometer': 65256,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-06',
 'seller_name': 'CarBuy Lltd',
 'title': 'MAZDA CX-3 DIESEL HATCHBACK 1.5d Sport Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5d Sport Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117568753%27 HTTP/1.1" 200 None
2025-12-04 19:01:05 [astonbarclay.gb] INFO: Saving data for 117568753: {'auction_closing_time': 1764936000.0, 'created_time': 1764270128.985777, 'last_price_update_time': 1764874865.822091}
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117568753') HTTP/1.1" 204 0
2025-12-04 19:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-04 19:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539
2025-12-04 19:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 01460e64-4cab-5bd2-9fc0-c07e97dc78a6 with identifier: 117022539 to the API
2025-12-04 19:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117022539?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '01460e64-4cab-5bd2-9fc0-c07e97dc78a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NG68LXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117022539',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK',
 'odometer': 42928,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-17',
 'seller_name': 'Auction Plus',
 'title': 'JEEP RENEGADE HATCHBACK 1.0 T3 GSE Longitude 5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Longitude 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117022539%27 HTTP/1.1" 200 None
2025-12-04 19:01:06 [astonbarclay.gb] INFO: Saving data for 117022539: {'auction_closing_time': 1764936000.0, 'created_time': 1763024481.81059, 'last_price_update_time': 1764874866.168652}
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117022539') HTTP/1.1" 204 0
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bdcd90>
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fcc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bd5fd0>
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:06 [scrapy.extensions.logstats] INFO: Crawled 90 pages (at 90 pages/min), scraped 46 items (at 46 items/min)
2025-12-04 19:01:06 [astonbarclay.gb] INFO: Found listing with ID: 117374439
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-12-04 19:01:06 [astonbarclay.gb] INFO: Scrape type for 117374439: 2
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fe1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59ed090>
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fbb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:06 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117700643, 'registration': 'MT68DTV', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 95 SE 5dr DSG', 'mileage': 10687, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-27', 'fuel': 'Petrol', 'motExpiry': '2023-10-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5094863b-582f-4f9b-9c6f-a1d2f09dacd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:06 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117700643, 'registration': 'MT68DTV', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 95 SE 5dr DSG', 'mileage': 10687, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-27', 'fuel': 'Petrol', 'motExpiry': '2023-10-26', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5094863b-582f-4f9b-9c6f-a1d2f09dacd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0e9bb39-f6fd-59e9-9478-78b819265858 with identifier: 117700643
2025-12-04 19:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0e9bb39-f6fd-59e9-9478-78b819265858 with scrape type 1
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b0e9bb39-f6fd-59e9-9478-78b819265858
2025-12-04 19:01:06 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b0e9bb39-f6fd-59e9-9478-78b819265858
2025-12-04 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0e9bb39-f6fd-59e9-9478-78b819265858, identifier: 117700643
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Found listing with ID: 117491120
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Scrape type for 117491120: 2
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117548959?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0e9bb39-f6fd-59e9-9478-78b819265858 with identifier: 117700643
2025-12-04 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0e9bb39-f6fd-59e9-9478-78b819265858 with identifier: 117700643
2025-12-04 19:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b0e9bb39-f6fd-59e9-9478-78b819265858 with identifier: 117700643 to the API
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b0e9bb39-f6fd-59e9-9478-78b819265858%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b0e9bb39-f6fd-59e9-9478-78b819265858: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:06 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117700643?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'b0e9bb39-f6fd-59e9-9478-78b819265858',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MT68DTV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700643',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 10687,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI 95 SE 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.0 TSI 95 SE 5dr DSG',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700643%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Saving data for 117700643: {'created_time': 1764874867.475694, 'last_price_update_time': 1764874867.475704, 'auction_closing_time': 1765215000.0}
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117700643') HTTP/1.1" 204 0
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117452490, 'registration': 'SB67GKV', 'account': 'FCC001', 'make': 'BMW', 'model': 'X5 ESTATE', 'derivative': 'xDrive40e M Sport 5dr Auto', 'mileage': 113348, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 502}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-07-17', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SB67GKV/2025-11-24/image/4aec8c6c-795e-4ffc-b3b1-c77d831caa05_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/b2566468-4162-404e-bea8-afc41d928cc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/1c4bc1ca-edef-4c59-a239-bec94f7d3e3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/bbcfb972-f6b8-4a2e-8b8a-adcbba5c5f0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/7d64c9d1-93df-4e6f-ba5f-62eac61ab6ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/847d4496-7d2d-41fa-b6fb-d4d001284b32_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/44a009e8-2169-48ff-9eca-058ef8708b8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/SB67GKV/2025-11-24/image/6b6ccf76-9e91-4f9a-8713-d43d8420a6e0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 03/19 22K 07/20-44K, 06/21-67K, 04/22-89K.', 'remarks': 'VOSA STATES MILES@ 111,761K, 111,769K, 111,815K, 111,827K. SPARE KEY IN OFFICE.', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 78, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d8496bbb-c93d-4e55-b81d-e93c6028c66c.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-04 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-12-04 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5e65083d-5e5f-588d-ae0f-977434105342 with scrape type 2
2025-12-04 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e65083d-5e5f-588d-ae0f-977434105342, identifier: 117452490
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117030784, 'registration': 'ST70WLA', 'account': 'CAR001', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] R DESIGN 5dr', 'mileage': 76966, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ST70WLA/2025-11-19/image/e0fd21b1-5518-4780-b188-055da44210b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/92b8ecf8-e605-4023-b0cc-4178716aecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/27c5c98e-cf0f-4a81-978e-494de7f66fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/3c565299-eabc-4f0a-aede-dafa87335c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/280d930c-dc40-40a5-b31c-d682e17ddc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c59e42a1-c799-4034-9cbd-4313776f9421_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/8e92044c-4db1-4c4f-8b72-733704d27bbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/d3f1333c-090f-44e0-b703-ac2a9ac4aa21_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c1dc4613-1082-409a-b0c3-6146bda6c24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/28e60581-2fd9-433d-9e13-795a332a4127_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/22- 18K, 01/23- 35K', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f400b6f6-ec7f-468b-b235-71abe0d98dba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117030784, 'registration': 'ST70WLA', 'account': 'CAR001', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] R DESIGN 5dr', 'mileage': 76966, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-06', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ST70WLA/2025-11-19/image/e0fd21b1-5518-4780-b188-055da44210b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/92b8ecf8-e605-4023-b0cc-4178716aecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/27c5c98e-cf0f-4a81-978e-494de7f66fa8_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/3c565299-eabc-4f0a-aede-dafa87335c97_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/280d930c-dc40-40a5-b31c-d682e17ddc4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c59e42a1-c799-4034-9cbd-4313776f9421_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/8e92044c-4db1-4c4f-8b72-733704d27bbc_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/d3f1333c-090f-44e0-b703-ac2a9ac4aa21_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/c1dc4613-1082-409a-b0c3-6146bda6c24f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST70WLA/2025-11-19/image/28e60581-2fd9-433d-9e13-795a332a4127_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/22- 18K, 01/23- 35K', 'remarks': 'VOSA STATES 50K, 67K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 160, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f400b6f6-ec7f-468b-b235-71abe0d98dba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-04 19:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b40d4a1-d927-531c-a055-ec0df601d776 with scrape type 2
2025-12-04 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b40d4a1-d927-531c-a055-ec0df601d776 with scrape type 2
2025-12-04 19:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8b40d4a1-d927-531c-a055-ec0df601d776, identifier: 117030784
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-04 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e65083d-5e5f-588d-ae0f-977434105342 with identifier: 117452490
2025-12-04 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
2025-12-04 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5e65083d-5e5f-588d-ae0f-977434105342 spider: astonbarclay.gb
2025-12-04 19:01:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5e65083d-5e5f-588d-ae0f-977434105342 due to rule: high_mileage_for_country.json, error: 182415 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182415
{'auction_title': '',
 'c_o_2_emission_value': 78,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '5e65083d-5e5f-588d-ae0f-977434105342',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SB67GKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452490',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5 ESTATE',
 'odometer': 113348,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-09',
 'seller_name': 'Local Dealer Group',
 'title': 'BMW X5 ESTATE xDrive40e M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive40e M Sport 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452490%27 HTTP/1.1" 200 None
2025-12-04 19:01:07 [astonbarclay.gb] INFO: Saving data for 117452490: {'auction_closing_time': 1764936000.0, 'created_time': 1764010992.773169, 'last_price_update_time': 1764874867.942178}
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452490') HTTP/1.1" 204 0
2025-12-04 19:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-04 19:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784
2025-12-04 19:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8b40d4a1-d927-531c-a055-ec0df601d776 with identifier: 117030784 to the API
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117030784?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 160,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8b40d4a1-d927-531c-a055-ec0df601d776',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ST70WLA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117030784',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 76966,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-30',
 'seller_name': 'CarGiant',
 'title': 'VOLVO XC40 ESTATE 1.5 T3 [163] R DESIGN 5dr',
 'transmission': 'manual',
 'trim': '1.5 T3 [163] R DESIGN 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117030784%27 HTTP/1.1" 200 None
2025-12-04 19:01:08 [astonbarclay.gb] INFO: Saving data for 117030784: {'auction_closing_time': 1764936000.0, 'created_time': 1762542317.504287, 'last_price_update_time': 1764874868.260322}
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117030784') HTTP/1.1" 204 0
2025-12-04 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:08 [astonbarclay.gb] INFO: Found listing with ID: 117550109
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-12-04 19:01:08 [astonbarclay.gb] INFO: Scrape type for 117550109: 2
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4932a10>
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Ff8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd49419d0>
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252Fc28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4939190>
2025-12-04 19:01:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4938a90>
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117459952?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117548959, 'registration': 'BG20TSY', 'account': 'THE109', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE GT Line 5dr EDC', 'mileage': 29181, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-06-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-03', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117548959, 'registration': 'BG20TSY', 'account': 'THE109', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.3 TCE GT Line 5dr EDC', 'mileage': 29181, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-06-11', 'fuel': 'Petrol', 'motExpiry': '2026-12-03', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 154, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: df15cebc-01f0-5632-9ade-7a8920bf750c with identifier: 117548959
2025-12-04 19:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item df15cebc-01f0-5632-9ade-7a8920bf750c with scrape type 1
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item df15cebc-01f0-5632-9ade-7a8920bf750c
2025-12-04 19:01:09 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item df15cebc-01f0-5632-9ade-7a8920bf750c
2025-12-04 19:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: df15cebc-01f0-5632-9ade-7a8920bf750c, identifier: 117548959
2025-12-04 19:01:09 [astonbarclay.gb] INFO: Found listing with ID: 117764042
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117764042%27 HTTP/1.1" 200 None
2025-12-04 19:01:09 [astonbarclay.gb] INFO: Scrape type for 117764042: 1
2025-12-04 19:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: df15cebc-01f0-5632-9ade-7a8920bf750c with identifier: 117548959
2025-12-04 19:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: df15cebc-01f0-5632-9ade-7a8920bf750c with identifier: 117548959
2025-12-04 19:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: df15cebc-01f0-5632-9ade-7a8920bf750c with identifier: 117548959 to the API
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27df15cebc-01f0-5632-9ade-7a8920bf750c%27 HTTP/1.1" 200 None
2025-12-04 19:01:09 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id df15cebc-01f0-5632-9ade-7a8920bf750c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:09 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117548959?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 154,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'df15cebc-01f0-5632-9ade-7a8920bf750c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG20TSY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117548959',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 29181,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-11',
 'seller_name': 'TCB Group - Prime',
 'title': 'RENAULT KADJAR HATCHBACK 1.3 TCE GT Line 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.3 TCE GT Line 5dr EDC',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117548959%27 HTTP/1.1" 200 None
2025-12-04 19:01:09 [astonbarclay.gb] INFO: Saving data for 117548959: {'created_time': 1764874869.962488, 'last_price_update_time': 1764874869.962497, 'auction_closing_time': 1765274400.0}
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117548959') HTTP/1.1" 204 0
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fa6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a9d090>
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c64910>
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c33810>
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117634236?view=catalogue)
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 116997754
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116997754%27 HTTP/1.1" 200 None
2025-12-04 19:01:10 [astonbarclay.gb] INFO: Scrape type for 116997754: 0
2025-12-04 19:01:10 [astonbarclay.gb] INFO: Found listing with ID: 117610571
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610571%27 HTTP/1.1" 200 None
2025-12-04 19:01:10 [astonbarclay.gb] INFO: Scrape type for 117610571: 1
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743414?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117374304?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425969?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c42c50>
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117459952, 'registration': 'MV67YWC', 'account': 'HEN022', 'make': 'SKODA', 'model': 'FABIA HATCHBACK', 'derivative': '1.0 TSI SE L 5dr', 'mileage': 62058, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV67YWC/2025-11-26/image/58a0cbde-2f7d-4907-965c-84084244c881_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/40120ae0-4ebd-4dc1-97da-59de14715c40_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95639384-2ef3-473b-abe6-eb71385f355f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/a5cc8a23-c1bb-4416-aff2-61b402fc39e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/cfd3c44b-9377-41bc-9927-0a2c29fe9fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95bdb120-e97f-4357-8f04-ce75a6cc2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/88b4450a-8db8-4bcc-aaa0-e201d98485f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/77ce2598-ef76-4576-aebd-994728cd94cc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K 37K 45K 53K 59K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1891536a-4fbb-422e-a0ec-5e46e7718cd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117459952, 'registration': 'MV67YWC', 'account': 'HEN022', 'make': 'SKODA', 'model': 'FABIA HATCHBACK', 'derivative': '1.0 TSI SE L 5dr', 'mileage': 62058, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-01', 'fuel': 'Petrol', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV67YWC/2025-11-26/image/58a0cbde-2f7d-4907-965c-84084244c881_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/40120ae0-4ebd-4dc1-97da-59de14715c40_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95639384-2ef3-473b-abe6-eb71385f355f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/a5cc8a23-c1bb-4416-aff2-61b402fc39e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/cfd3c44b-9377-41bc-9927-0a2c29fe9fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/95bdb120-e97f-4357-8f04-ce75a6cc2ed9_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/88b4450a-8db8-4bcc-aaa0-e201d98485f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV67YWC/2025-11-26/image/77ce2598-ef76-4576-aebd-994728cd94cc_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 20K 27K 37K 45K 53K 59K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1891536a-4fbb-422e-a0ec-5e46e7718cd7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-04 19:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with scrape type 2
2025-12-04 19:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with scrape type 2
2025-12-04 19:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b, identifier: 117459952
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117603564
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117603564%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117603564: 0
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117746844
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117746844%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117746844: 0
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117769180
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117769180%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117769180: 1
2025-12-04 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117573049?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-04 19:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952
2025-12-04 19:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b with identifier: 117459952 to the API
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117459952?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'afdcbfd7-dc7b-5f5d-8526-f5c9bc8abb2b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV67YWC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117459952',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'FABIA HATCHBACK',
 'odometer': 62058,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-01',
 'seller_name': 'Car360',
 'title': 'SKODA FABIA HATCHBACK 1.0 TSI SE L 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI SE L 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117459952%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Saving data for 117459952: {'auction_closing_time': 1765274400.0, 'created_time': 1764184101.826289, 'last_price_update_time': 1764874871.71396}
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117459952') HTTP/1.1" 204 0
2025-12-04 19:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117664913
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117664913%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117664913: 0
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Found listing with ID: 117293082
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-12-04 19:01:11 [astonbarclay.gb] INFO: Scrape type for 117293082: 2
2025-12-04 19:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117543807?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a8d0d0>
2025-12-04 19:01:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a8f7d0>
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBD16ATV%252F2025-12-04%252Fimage%252F260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629
2025-12-04 19:01:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629, skipping ID generation
2025-12-04 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 with scrape type 1
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 from tracking dictionaries
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 sending to next pipeline
2025-12-04 19:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629, identifier: 117634236
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b02490>
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fe1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd49174d0>
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743414, 'registration': 'PJ68ZPH', 'account': 'MOT075', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL SPORTS TOURER', 'derivative': '2.0 Turbo D Elite Nav 5dr Auto', 'mileage': 62816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/52867c20-174e-4890-b42b-246961e8349e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743414, 'registration': 'PJ68ZPH', 'account': 'MOT075', 'make': 'VAUXHALL', 'model': 'INSIGNIA DIESEL SPORTS TOURER', 'derivative': '2.0 Turbo D Elite Nav 5dr Auto', 'mileage': 62816, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-01-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1956, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/52867c20-174e-4890-b42b-246961e8349e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff08545-b830-5e28-8080-cb46c8b330bf with identifier: 117743414
2025-12-04 19:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff08545-b830-5e28-8080-cb46c8b330bf with scrape type 1
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item fff08545-b830-5e28-8080-cb46c8b330bf
2025-12-04 19:01:12 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item fff08545-b830-5e28-8080-cb46c8b330bf
2025-12-04 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fff08545-b830-5e28-8080-cb46c8b330bf, identifier: 117743414
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117374304, 'registration': 'AO71XXK', 'account': 'GRE064', 'make': 'VAUXHALL', 'model': 'CORSA ELECTRIC HATCHBACK', 'derivative': '100kW Elite Nav Premium 50kWh 5dr Auto [7.4kWCh]', 'mileage': 55821, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-25', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO71XXK/2025-11-24/image/86359d2b-6678-42a4-a143-531a20d62ce9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/3fae752a-bc0a-49f9-835b-4f2c925bb88b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/67293924-6862-4686-926e-9675338d134a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/3d5f99fb-b98c-48f8-8373-c610ca130426_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/41ffd0ee-a798-4b08-839a-0a844a3014a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/2ca04f6d-bc13-4445-befd-af212c575b6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/d0fbeb12-2822-4da9-b177-9eb7b68f93f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/7233a3d9-7c0c-4b51-9ec5-d0c21e36ee72_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/b69161fc-e566-4c3a-9bae-ba6010ea20f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/f588f5bb-ffb3-4df5-b1df-c001887e4f1d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/22- 7k, 09/22- 16k, 07/23- 32k, 07/24- 50k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee4694a3-4815-466f-ac03-2c1b445cc652.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117374304, 'registration': 'AO71XXK', 'account': 'GRE064', 'make': 'VAUXHALL', 'model': 'CORSA ELECTRIC HATCHBACK', 'derivative': '100kW Elite Nav Premium 50kWh 5dr Auto [7.4kWCh]', 'mileage': 55821, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-11-25', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AO71XXK/2025-11-24/image/86359d2b-6678-42a4-a143-531a20d62ce9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/3fae752a-bc0a-49f9-835b-4f2c925bb88b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/67293924-6862-4686-926e-9675338d134a_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/3d5f99fb-b98c-48f8-8373-c610ca130426_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/41ffd0ee-a798-4b08-839a-0a844a3014a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/2ca04f6d-bc13-4445-befd-af212c575b6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/d0fbeb12-2822-4da9-b177-9eb7b68f93f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/7233a3d9-7c0c-4b51-9ec5-d0c21e36ee72_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/b69161fc-e566-4c3a-9bae-ba6010ea20f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO71XXK/2025-11-24/image/f588f5bb-ffb3-4df5-b1df-c001887e4f1d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 04/22- 7k, 09/22- 16k, 07/23- 32k, 07/24- 50k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ee4694a3-4815-466f-ac03-2c1b445cc652.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffcbabc4-379d-5c8e-8d11-3b71125f3b52 with identifier: 117374304
2025-12-04 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffcbabc4-379d-5c8e-8d11-3b71125f3b52 with scrape type 2
2025-12-04 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffcbabc4-379d-5c8e-8d11-3b71125f3b52 with scrape type 2
2025-12-04 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffcbabc4-379d-5c8e-8d11-3b71125f3b52, identifier: 117374304
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117425969, 'registration': 'DS74RHY', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo 130 Ultimate 5dr Auto', 'mileage': 14669, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-11-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS74RHY/2025-11-24/image/2ca58ece-afe0-485d-ac97-af3c9b026f13_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/99c18d02-da47-46f7-aac3-83384b2d4fb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/73c97441-f3f4-4ca2-939b-008877fcc8d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/25ac10c1-0787-43e7-95f9-39c695a07512_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/c32dd8c6-eec7-4e98-a509-790dc9a77a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/96592070-3676-4dbe-b028-9c022da49841_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/299aaef9-40f7-45f3-b9b9-8ca97aff5ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/530203c9-5b03-4d77-9f4b-81abd8977b2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/9e4aa9b0-2153-42ea-8b46-f1fe61dc4b24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/9ee90b2c-63c9-4027-8f08-6d7c26079560_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/df91c02b-d375-445f-b5df-c5e1efe154dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/610bfb49-e5fd-4c08-b03a-992d065b542b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/e82ff555-50a1-47ed-bed9-c7566e8b5be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/6e850e1d-9de3-4ca4-a316-c300b428d36f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 05/25- 9k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9214fb09-0fa2-4a4c-98c6-e24c77c58074.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117425969, 'registration': 'DS74RHY', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo 130 Ultimate 5dr Auto', 'mileage': 14669, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-11-08', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS74RHY/2025-11-24/image/2ca58ece-afe0-485d-ac97-af3c9b026f13_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/99c18d02-da47-46f7-aac3-83384b2d4fb7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/73c97441-f3f4-4ca2-939b-008877fcc8d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/25ac10c1-0787-43e7-95f9-39c695a07512_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/c32dd8c6-eec7-4e98-a509-790dc9a77a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/96592070-3676-4dbe-b028-9c022da49841_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/299aaef9-40f7-45f3-b9b9-8ca97aff5ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/530203c9-5b03-4d77-9f4b-81abd8977b2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/9e4aa9b0-2153-42ea-8b46-f1fe61dc4b24_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/9ee90b2c-63c9-4027-8f08-6d7c26079560_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/df91c02b-d375-445f-b5df-c5e1efe154dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/610bfb49-e5fd-4c08-b03a-992d065b542b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/e82ff555-50a1-47ed-bed9-c7566e8b5be5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS74RHY/2025-11-24/image/6e850e1d-9de3-4ca4-a316-c300b428d36f_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 05/25- 9k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9214fb09-0fa2-4a4c-98c6-e24c77c58074.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with identifier: 117425969
2025-12-04 19:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with scrape type 2
2025-12-04 19:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with scrape type 2
2025-12-04 19:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33a12f8f-1230-546f-b2e2-6a1a7a856d33, identifier: 117425969
2025-12-04 19:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117323884?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 with identifier: 117634236
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 with identifier: 117634236
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'skoda octavia diesel estate 2.0 tdi cr scout 4x4 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia diesel estate', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135220, 'odometer_reading_unit': 'mi', 'registration_date': '2016-05-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634236', 'expiration_date': '2025-12-08t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr scout 4x4 5dr', 'license_plate': 'bd16atv', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 125, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7941ab5f-f9ee-5a45-ba1f-60aaaea43629', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29454}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32673}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46596}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42334}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44910}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51029}], 'current_year_diff': 9, 'age_in_months': 114, 'make_model': 'skoda octavia diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 217614}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 114,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-08t17:30:00z',
     'fuel_type': 'diesel',
     'id': '7941ab5f-f9ee-5a45-ba1f-60aaaea43629',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bd16atv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634236',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'skoda',
     'make_model': 'skoda octavia diesel estate',
     'model': 'octavia diesel estate',
     'odometer': 135220,
     'odometer_in_km': 217614,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30340,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29454,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33622,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32673,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37622,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46596,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42334,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44910,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51029,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-05-05',
     'sanitized_make': 'skoda',
     'seller_name': 'tcb group - prime',
     'title': 'skoda octavia diesel estate 2.0 tdi cr scout 4x4 5dr',
     'transmission': 'manual',
     'trim': '2.0 tdi cr scout 4x4 5dr',
     'vin': None,
     'year': 2016}
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 spider: astonbarclay.gb
2025-12-04 19:01:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7941ab5f-f9ee-5a45-ba1f-60aaaea43629 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 10, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'skoda octavia diesel estate 2.0 tdi cr scout 4x4 5dr', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'octavia diesel estate', 'transmission': 'manual', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 135220, 'odometer_reading_unit': 'mi', 'registration_date': '2016-05-05', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634236', 'expiration_date': '2025-12-08t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr scout 4x4 5dr', 'license_plate': 'bd16atv', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 125, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '7941ab5f-f9ee-5a45-ba1f-60aaaea43629', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30340}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 29454}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 32673}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37622}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46596}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 42334}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 44910}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 46561}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 51029}], 'current_year_diff': 9, 'age_in_months': 114, 'make_model': 'skoda octavia diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 217614}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 114,
     'auction_title': '',
     'c_o_2_emission_value': 125,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-08t17:30:00z',
     'fuel_type': 'diesel',
     'id': '7941ab5f-f9ee-5a45-ba1f-60aaaea43629',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'bd16atv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634236',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'skoda',
     'make_model': 'skoda octavia diesel estate',
     'model': 'octavia diesel estate',
     'odometer': 135220,
     'odometer_in_km': 217614,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30340,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 29454,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33622,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 32673,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37622,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46596,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 42334,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 44910,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 46561,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 51029,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-05-05',
     'sanitized_make': 'skoda',
     'seller_name': 'tcb group - prime',
     'title': 'skoda octavia diesel estate 2.0 tdi cr scout 4x4 5dr',
     'transmission': 'manual',
     'trim': '2.0 tdi cr scout 4x4 5dr',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '7941ab5f-f9ee-5a45-ba1f-60aaaea43629',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD16ATV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634236',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'OCTAVIA DIESEL ESTATE',
 'odometer': 135220,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30340,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/ec32a25d-fae3-41b8-b2bc-653b7db0854e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29454,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/62725c3a-8341-4580-9300-77a94a34ead1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33622,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/cc887290-50fe-4124-bc17-8edefa2b061c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32673,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/3de808cf-d63d-4840-a0c9-30b287dd6d7c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37622,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/f8845817-29f1-4429-a7a2-36eb8d6f8d76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46596,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/c28dba5c-d678-4e1c-b696-5375e4959cb6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42334,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9565e94c-3b28-4fdc-b147-be881b8b8ff2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44910,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/5f5a3a5a-756f-456a-8271-2f5a53aa6646_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46561,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/260ca1ed-1ffb-4c52-8b85-8017557617b5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7941ab5f-f9ee-5a45-ba1f-60aaaea43629/7941ab5f-f9ee-5a45-ba1f-60aaaea43629_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51029,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BD16ATV/2025-12-04/image/9ef5489e-7e27-42ae-a7d9-f777ab5b6c29_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-05',
 'seller_name': 'TCB Group - Prime',
 'title': 'SKODA OCTAVIA DIESEL ESTATE 2.0 TDI CR Scout 4x4 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI CR Scout 4x4 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634236%27 HTTP/1.1" 200 None
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Saving data for 117634236: {'created_time': 1764874873.52834, 'last_price_update_time': 1764874873.528352, 'auction_closing_time': 1765215000.0}
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634236') HTTP/1.1" 204 0
2025-12-04 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fff08545-b830-5e28-8080-cb46c8b330bf with identifier: 117743414
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fff08545-b830-5e28-8080-cb46c8b330bf with identifier: 117743414
2025-12-04 19:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fff08545-b830-5e28-8080-cb46c8b330bf with identifier: 117743414 to the API
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fff08545-b830-5e28-8080-cb46c8b330bf%27 HTTP/1.1" 200 None
2025-12-04 19:01:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fff08545-b830-5e28-8080-cb46c8b330bf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117743414?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fff08545-b830-5e28-8080-cb46c8b330bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PJ68ZPH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743414',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA DIESEL SPORTS TOURER',
 'odometer': 62816,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-31',
 'seller_name': 'MotoNovo Finance',
 'title': 'VAUXHALL INSIGNIA DIESEL SPORTS TOURER 2.0 Turbo D Elite Nav 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 Turbo D Elite Nav 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743414%27 HTTP/1.1" 200 None
2025-12-04 19:01:13 [astonbarclay.gb] INFO: Saving data for 117743414: {'created_time': 1764874873.838847, 'last_price_update_time': 1764874873.838857, 'auction_closing_time': 1765274400.0}
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743414') HTTP/1.1" 204 0
2025-12-04 19:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffcbabc4-379d-5c8e-8d11-3b71125f3b52 with identifier: 117374304
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffcbabc4-379d-5c8e-8d11-3b71125f3b52 with identifier: 117374304
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'greenhous group', 'price_includes_vat': False, 'title': 'vauxhall corsa electric hatchback 100kw elite nav premium 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 55821, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374304', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw elite nav premium 50kwh 5dr auto [7.4kwch]', 'license_plate': 'ao71xxk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ffcbabc4-379d-5c8e-8d11-3b71125f3b52', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'vauxhall corsa electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 89834} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'electric',
     'id': 'ffcbabc4-379d-5c8e-8d11-3b71125f3b52',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ao71xxk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374304',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa electric hatchback',
     'model': 'corsa electric hatchback',
     'odometer': 55821,
     'odometer_in_km': 89834,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-25',
     'sanitized_make': 'vauxhall',
     'seller_name': 'greenhous group',
     'title': 'vauxhall corsa electric hatchback 100kw elite nav premium '
              '50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav premium 50kwh 5dr auto [7.4kwch]',
     'vin': None,
     'year': 2021}
2025-12-04 19:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: ffcbabc4-379d-5c8e-8d11-3b71125f3b52 spider: astonbarclay.gb
2025-12-04 19:01:14 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ffcbabc4-379d-5c8e-8d11-3b71125f3b52 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'greenhous group', 'price_includes_vat': False, 'title': 'vauxhall corsa electric hatchback 100kw elite nav premium 50kwh 5dr auto [7.4kwch]', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'corsa electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 55821, 'odometer_reading_unit': 'mi', 'registration_date': '2021-11-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374304', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw elite nav premium 50kwh 5dr auto [7.4kwch]', 'license_plate': 'ao71xxk', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'ffcbabc4-379d-5c8e-8d11-3b71125f3b52', 'current_year_diff': 4, 'age_in_months': 48, 'make_model': 'vauxhall corsa electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 89834} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 48,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'electric',
     'id': 'ffcbabc4-379d-5c8e-8d11-3b71125f3b52',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ao71xxk',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374304',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall corsa electric hatchback',
     'model': 'corsa electric hatchback',
     'odometer': 55821,
     'odometer_in_km': 89834,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-11-25',
     'sanitized_make': 'vauxhall',
     'seller_name': 'greenhous group',
     'title': 'vauxhall corsa electric hatchback 100kw elite nav premium '
              '50kwh 5dr auto [7.4kwch]',
     'transmission': 'automatic',
     'trim': '100kw elite nav premium 50kwh 5dr auto [7.4kwch]',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Electric',
 'id': 'ffcbabc4-379d-5c8e-8d11-3b71125f3b52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO71XXK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374304',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CORSA ELECTRIC HATCHBACK',
 'odometer': 55821,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-25',
 'seller_name': 'Greenhous Group',
 'title': 'VAUXHALL CORSA ELECTRIC HATCHBACK 100kW Elite Nav Premium 50kWh 5dr '
          'Auto [7.4kWCh]',
 'transmission': 'automatic',
 'trim': '100kW Elite Nav Premium 50kWh 5dr Auto [7.4kWCh]',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374304%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Saving data for 117374304: {'auction_closing_time': 1764936000.0, 'created_time': 1763751729.209727, 'last_price_update_time': 1764874874.060731}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117374304') HTTP/1.1" 204 0
2025-12-04 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with identifier: 117425969
2025-12-04 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with identifier: 117425969
2025-12-04 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 33a12f8f-1230-546f-b2e2-6a1a7a856d33 with identifier: 117425969 to the API
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2733a12f8f-1230-546f-b2e2-6a1a7a856d33%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 33a12f8f-1230-546f-b2e2-6a1a7a856d33: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117425969?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '33a12f8f-1230-546f-b2e2-6a1a7a856d33',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS74RHY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425969',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 14669,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-08',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 Turbo 130 Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo 130 Ultimate 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425969%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Saving data for 117425969: {'auction_closing_time': 1764936000.0, 'created_time': 1763751875.797583, 'last_price_update_time': 1764874874.354098}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425969') HTTP/1.1" 204 0
2025-12-04 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763955?view=catalogue)
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 117551950
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Scrape type for 117551950: 2
2025-12-04 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117573049, 'registration': 'DS73UTJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 4286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/96a554c4-9378-49e2-8d13-9a6f75d8ed6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/af2b72d2-7348-4af3-9229-edf2929d2912_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/2c765dad-f862-4d14-982a-7c10adaca8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/0cb03e29-68fe-4eaa-b403-681f6a00f467_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/496eed7d-cccc-4fb9-a932-dbdb8ca453f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/34472bdd-49f2-4691-bb08-a62d4502b8a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/4100e3df-7f78-437b-8b72-b608ce87b173_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/cd2d35bd-262a-4958-8093-248f5079bba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/e7602ef6-7507-4f5e-b017-c812cc5fb554_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/778f4704-d3c0-4fb6-b339-8fba8bf6564a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/24-3K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a89bc73-08a4-4f68-9b04-f289e9492d82.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117573049, 'registration': 'DS73UTJ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'GRANDLAND HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr', 'mileage': 4286, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/96a554c4-9378-49e2-8d13-9a6f75d8ed6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/af2b72d2-7348-4af3-9229-edf2929d2912_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/2c765dad-f862-4d14-982a-7c10adaca8bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/0cb03e29-68fe-4eaa-b403-681f6a00f467_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/496eed7d-cccc-4fb9-a932-dbdb8ca453f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/34472bdd-49f2-4691-bb08-a62d4502b8a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/4100e3df-7f78-437b-8b72-b608ce87b173_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/cd2d35bd-262a-4958-8093-248f5079bba6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/e7602ef6-7507-4f5e-b017-c812cc5fb554_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS73UTJ/2025-11-28/image/778f4704-d3c0-4fb6-b339-8fba8bf6564a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/24-3K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3a89bc73-08a4-4f68-9b04-f289e9492d82.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-12-04 19:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 239579f9-3161-5982-a032-dd293c2c3386 with scrape type 2
2025-12-04 19:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 239579f9-3161-5982-a032-dd293c2c3386 with scrape type 2
2025-12-04 19:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 239579f9-3161-5982-a032-dd293c2c3386, identifier: 117573049
2025-12-04 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117705864?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-12-04 19:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049
2025-12-04 19:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 239579f9-3161-5982-a032-dd293c2c3386 with identifier: 117573049 to the API
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27239579f9-3161-5982-a032-dd293c2c3386%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 239579f9-3161-5982-a032-dd293c2c3386: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117573049?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '239579f9-3161-5982-a032-dd293c2c3386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS73UTJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117573049',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND HATCHBACK',
 'odometer': 4286,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL GRANDLAND HATCHBACK 1.2 Turbo Ultimate 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Ultimate 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573049%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Saving data for 117573049: {'auction_closing_time': 1764936000.0, 'created_time': 1764270154.003047, 'last_price_update_time': 1764874874.792621}
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117573049') HTTP/1.1" 204 0
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 117631028
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117631028%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Scrape type for 117631028: 0
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 117599696
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599696%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Scrape type for 117599696: 0
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Found listing with ID: 117768238
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768238%27 HTTP/1.1" 200 None
2025-12-04 19:01:14 [astonbarclay.gb] INFO: Scrape type for 117768238: 1
2025-12-04 19:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4922390>
2025-12-04 19:01:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117543807, 'registration': 'YT71TTZ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 35808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-09-24', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/9c944550-8401-4724-9dc0-2e8df8398794_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/c27738d5-6032-41e1-ab43-3ccce0806e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/830adf1d-545b-4e4e-8273-f1bb2e6ca81e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/20f10ac4-56fb-46a3-9aa0-f0234531e1f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/3af20e00-7214-4d9f-b914-76c0bb570d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/67b09bd2-5c5a-4add-9f37-284bda73e215_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/d5a51f85-0496-4f18-b401-a29a404716e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/a6987cdb-1c2c-48a7-b2d9-93a50454b489_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/3f09d158-ee73-4048-a321-c1e1392adb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/f03e7f41-bab5-48ca-904f-a53ac998ba89_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/22-9k 01/24-18k 02/25-25k', 'remarks': 'ADAPTIONS REMOVED - LEFT FOOT THROTTLE HANDS CONTROL HOIST / SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0f8cc0c2-608a-458d-aa3b-7c1063c08745.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117543807, 'registration': 'YT71TTZ', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 35808, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-09-24', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/9c944550-8401-4724-9dc0-2e8df8398794_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/c27738d5-6032-41e1-ab43-3ccce0806e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/830adf1d-545b-4e4e-8273-f1bb2e6ca81e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/20f10ac4-56fb-46a3-9aa0-f0234531e1f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/3af20e00-7214-4d9f-b914-76c0bb570d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/67b09bd2-5c5a-4add-9f37-284bda73e215_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/d5a51f85-0496-4f18-b401-a29a404716e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/a6987cdb-1c2c-48a7-b2d9-93a50454b489_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/3f09d158-ee73-4048-a321-c1e1392adb1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YT71TTZ/2025-12-02/image/f03e7f41-bab5-48ca-904f-a53ac998ba89_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/22-9k 01/24-18k 02/25-25k', 'remarks': 'ADAPTIONS REMOVED - LEFT FOOT THROTTLE HANDS CONTROL HOIST / SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0f8cc0c2-608a-458d-aa3b-7c1063c08745.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with identifier: 117543807
2025-12-04 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with scrape type 2
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with scrape type 2
2025-12-04 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6b1051ac-80eb-5d87-b856-6cf9f087aef3, identifier: 117543807
2025-12-04 19:01:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117323884, 'registration': 'EO72LHB', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 39825, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72LHB/2025-11-25/image/1402c3e9-cf15-4079-bf99-c440aae561ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/abda4e66-df03-442e-a610-21a5f9683105_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/32bc0122-1469-463d-8e13-9053b27415b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/5725fb64-1c4f-41a9-a4ef-6f94e5c03c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/4f4ba312-1fb6-41ad-8750-c3f5e64d0111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/3872c46c-6fa3-41da-80ca-168f199b744d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/33b87da2-328e-41c1-9768-3c9084e6d952_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/ea1a71dc-071e-4370-88de-c40af40a8b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/6372c09b-039e-4f58-99ef-c99fa72a9279_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/aad20084-e8e7-45e8-9a57-007fe84075cd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23- 13k, 06/25- 34k', 'remarks': 'ADAPTIONS REMOVED - HELPING HANDLE FRONT PASSENGER SIDE vosa - 38k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d27feae-c5f9-41d6-bc80-9e0126339b3f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117323884, 'registration': 'EO72LHB', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'ARKANA ESTATE', 'derivative': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto', 'mileage': 39825, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-04', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-03', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EO72LHB/2025-11-25/image/1402c3e9-cf15-4079-bf99-c440aae561ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/abda4e66-df03-442e-a610-21a5f9683105_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/32bc0122-1469-463d-8e13-9053b27415b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/5725fb64-1c4f-41a9-a4ef-6f94e5c03c0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/4f4ba312-1fb6-41ad-8750-c3f5e64d0111_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/3872c46c-6fa3-41da-80ca-168f199b744d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/33b87da2-328e-41c1-9768-3c9084e6d952_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/ea1a71dc-071e-4370-88de-c40af40a8b18_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/6372c09b-039e-4f58-99ef-c99fa72a9279_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72LHB/2025-11-25/image/aad20084-e8e7-45e8-9a57-007fe84075cd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/23- 13k, 06/25- 34k', 'remarks': 'ADAPTIONS REMOVED - HELPING HANDLE FRONT PASSENGER SIDE vosa - 38k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4d27feae-c5f9-41d6-bc80-9e0126339b3f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-12-04 19:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc24f454-acd3-5735-be2c-092338a240ed with scrape type 2
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc24f454-acd3-5735-be2c-092338a240ed with scrape type 2
2025-12-04 19:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fc24f454-acd3-5735-be2c-092338a240ed, identifier: 117323884
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4928910>
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252F767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aac410>
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c15510>
2025-12-04 19:01:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FDU67FNV%252F2025-12-04%252Fimage%252Fa6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 223e29a2-63ad-5101-818d-a907cca65400
2025-12-04 19:01:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 223e29a2-63ad-5101-818d-a907cca65400, skipping ID generation
2025-12-04 19:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 223e29a2-63ad-5101-818d-a907cca65400 with scrape type 1
2025-12-04 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 223e29a2-63ad-5101-818d-a907cca65400 from tracking dictionaries
2025-12-04 19:01:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 223e29a2-63ad-5101-818d-a907cca65400 sending to next pipeline
2025-12-04 19:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 223e29a2-63ad-5101-818d-a907cca65400, identifier: 117763955
2025-12-04 19:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767385?view=catalogue)
2025-12-04 19:01:16 [astonbarclay.gb] INFO: Found listing with ID: 117766803
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117766803%27 HTTP/1.1" 200 None
2025-12-04 19:01:16 [astonbarclay.gb] INFO: Scrape type for 117766803: 1
2025-12-04 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with identifier: 117543807
2025-12-04 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with identifier: 117543807
2025-12-04 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6b1051ac-80eb-5d87-b856-6cf9f087aef3 with identifier: 117543807 to the API
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276b1051ac-80eb-5d87-b856-6cf9f087aef3%27 HTTP/1.1" 200 None
2025-12-04 19:01:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6b1051ac-80eb-5d87-b856-6cf9f087aef3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117543807?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '6b1051ac-80eb-5d87-b856-6cf9f087aef3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YT71TTZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117543807',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 35808,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-24',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Exclusive 5dr DCT',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543807%27 HTTP/1.1" 200 None
2025-12-04 19:01:16 [astonbarclay.gb] INFO: Saving data for 117543807: {'auction_closing_time': 1765275300.0, 'created_time': 1764184174.840491, 'last_price_update_time': 1764874876.493369}
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117543807') HTTP/1.1" 204 0
2025-12-04 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-12-04 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884
2025-12-04 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fc24f454-acd3-5735-be2c-092338a240ed with identifier: 117323884 to the API
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fc24f454-acd3-5735-be2c-092338a240ed%27 HTTP/1.1" 200 None
2025-12-04 19:01:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fc24f454-acd3-5735-be2c-092338a240ed: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117323884?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'fc24f454-acd3-5735-be2c-092338a240ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO72LHB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117323884',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'RENAULT',
 'model': 'ARKANA ESTATE',
 'odometer': 39825,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-04',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT ARKANA ESTATE 1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH Hybrid 145 R.S. Line 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117323884%27 HTTP/1.1" 200 None
2025-12-04 19:01:16 [astonbarclay.gb] INFO: Saving data for 117323884: {'auction_closing_time': 1764936000.0, 'created_time': 1763492762.760874, 'last_price_update_time': 1764874876.861613}
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117323884') HTTP/1.1" 204 0
2025-12-04 19:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 223e29a2-63ad-5101-818d-a907cca65400 with identifier: 117763955
2025-12-04 19:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 223e29a2-63ad-5101-818d-a907cca65400 with identifier: 117763955
2025-12-04 19:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 223e29a2-63ad-5101-818d-a907cca65400 with identifier: 117763955 to the API
2025-12-04 19:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '223e29a2-63ad-5101-818d-a907cca65400',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DU67FNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763955',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA X HATCHBACK',
 'odometer': 52560,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32869,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/bb8657c1-c50f-4f2d-b654-c8abaf1a8728_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/24f793dd-0403-4e4a-a096-f2ab5ad6a721_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29028,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/32a77236-720a-482f-aced-b1b49c24d437_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26491,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/4c868bcf-5f2b-47c7-90e8-da4bce9cfa73_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55221,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/653d13a8-6a34-4fd3-ae5c-e3d15c4eb9d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53876,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/e1ad68f8-65fd-4e06-9dce-34fa58e21231_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45440,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/47754d28-13ea-415f-8d0e-cdc2eee78cc7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46375,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/767ff44c-ee64-4211-b36d-0d687fd4ceff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_223e29a2-63ad-5101-818d-a907cca65400/223e29a2-63ad-5101-818d-a907cca65400_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36228,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/DU67FNV/2025-12-04/image/a6736d36-6ef8-4e3d-b7b5-54dd91b504e6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-30',
 'seller_name': 'Manamanx Ltd',
 'title': 'VAUXHALL MOKKA X HATCHBACK 1.4T Design Nav 5dr',
 'transmission': 'manual',
 'trim': '1.4T Design Nav 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763955%27 HTTP/1.1" 200 None
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Saving data for 117763955: {'created_time': 1764874877.430665, 'last_price_update_time': 1764874877.430676, 'auction_closing_time': 1765215000.0}
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117763955') HTTP/1.1" 204 0
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b5b550>
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252Ff992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117705864, 'registration': 'WA70JAU', 'account': 'MOT070', 'make': 'FORD', 'model': 'GRAND TOURNEO CONNECT DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Zetec 5dr Powershift', 'mileage': 2918, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': 704, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA70JAU/2025-12-03/image/9020a1fd-57ba-4cce-81cf-94a4740c3674_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/ea1651f4-a939-4548-8b2e-9f7afea5c18e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/311bfc7f-16c8-4e43-a673-5250a8a3d1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/1bff5f5a-681d-4593-81f3-56c1aeb775ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/538a0917-1fbd-4983-a1d1-4044a5210522_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/e6edb3e1-de55-4788-b34b-8a6392497df8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/da56a139-45d8-45ae-a888-66368a4b9bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/f07c8fc3-e314-4803-a452-42cd2684fb8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/408f646e-5d7c-492e-8868-cc4c4e5218f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/835d8629-f703-40b2-8f76-da07a3ac0ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/a857263d-0c97-4f2a-af91-dc4148a96e39_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/e5a84666-f2bd-49c5-86bb-713d9c8b55b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/d566eaad-0636-4241-9c76-42815e59a501_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22-2k 08/24-2k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 172, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20d2dcc0-d935-4630-bcb4-6f17bf3e2a81.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117705864, 'registration': 'WA70JAU', 'account': 'MOT070', 'make': 'FORD', 'model': 'GRAND TOURNEO CONNECT DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Zetec 5dr Powershift', 'mileage': 2918, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': 704, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-21', 'fuel': 'Diesel', 'motExpiry': '2026-10-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WA70JAU/2025-12-03/image/9020a1fd-57ba-4cce-81cf-94a4740c3674_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/ea1651f4-a939-4548-8b2e-9f7afea5c18e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/311bfc7f-16c8-4e43-a673-5250a8a3d1bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/1bff5f5a-681d-4593-81f3-56c1aeb775ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/538a0917-1fbd-4983-a1d1-4044a5210522_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/e6edb3e1-de55-4788-b34b-8a6392497df8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/da56a139-45d8-45ae-a888-66368a4b9bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/f07c8fc3-e314-4803-a452-42cd2684fb8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/408f646e-5d7c-492e-8868-cc4c4e5218f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/835d8629-f703-40b2-8f76-da07a3ac0ec8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/a857263d-0c97-4f2a-af91-dc4148a96e39_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/e5a84666-f2bd-49c5-86bb-713d9c8b55b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WA70JAU/2025-12-03/image/d566eaad-0636-4241-9c76-42815e59a501_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/22-2k 08/24-2k', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 172, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20d2dcc0-d935-4630-bcb4-6f17bf3e2a81.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90a64723-675b-5a28-908a-08e8f554ca4e with identifier: 117705864
2025-12-04 19:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90a64723-675b-5a28-908a-08e8f554ca4e with scrape type 2
2025-12-04 19:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90a64723-675b-5a28-908a-08e8f554ca4e with scrape type 2
2025-12-04 19:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 90a64723-675b-5a28-908a-08e8f554ca4e, identifier: 117705864
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 117587813
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117587813%27 HTTP/1.1" 200 None
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Scrape type for 117587813: 0
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 117691830
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117691830%27 HTTP/1.1" 200 None
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Scrape type for 117691830: 0
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Found listing with ID: 117507292
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-12-04 19:01:17 [astonbarclay.gb] INFO: Scrape type for 117507292: 2
2025-12-04 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117491120?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550109?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117374356?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 90a64723-675b-5a28-908a-08e8f554ca4e with identifier: 117705864
2025-12-04 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 90a64723-675b-5a28-908a-08e8f554ca4e with identifier: 117705864
2025-12-04 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'ford' containing 'ford' and model 'grand tourneo connect diesel estate' containing 'tourneo'
2025-12-04 19:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 90a64723-675b-5a28-908a-08e8f554ca4e spider: astonbarclay.gb
2025-12-04 19:01:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 90a64723-675b-5a28-908a-08e8f554ca4e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'ford' containing 'ford' and model 'grand tourneo connect diesel estate' containing 'tourneo'
{'auction_title': '',
 'c_o_2_emission_value': 172,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': '90a64723-675b-5a28-908a-08e8f554ca4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WA70JAU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117705864',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'GRAND TOURNEO CONNECT DIESEL ESTATE',
 'odometer': 2918,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-21',
 'seller_name': 'Motability Operations',
 'title': 'FORD GRAND TOURNEO CONNECT DIESEL ESTATE 1.5 EcoBlue 120 Zetec 5dr '
          'Powershift',
 'transmission': 'automatic',
 'trim': '1.5 EcoBlue 120 Zetec 5dr Powershift',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705864%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Saving data for 117705864: {'auction_closing_time': 1765275300.0, 'created_time': 1764752507.741794, 'last_price_update_time': 1764874878.1843}
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117705864') HTTP/1.1" 204 0
2025-12-04 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117700117
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700117%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117700117: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117639048
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639048%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117639048: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117444372
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444372%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117444372: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117677344
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117677344%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117677344: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117578188
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117578188%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117578188: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117604347
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604347%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117604347: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117444914
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444914%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117444914: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 116896181
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116896181%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 116896181: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 116891404
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891404%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 116891404: 0
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Found listing with ID: 117272128
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-12-04 19:01:18 [astonbarclay.gb] INFO: Scrape type for 117272128: 2
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48bff10>
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FAP66CFJ%252F2025-12-04%252Fimage%252F0317816d-9635-4781-b497-761fbc755a99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 988e0459-29b3-5254-a7c7-c09dd15de559
2025-12-04 19:01:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 988e0459-29b3-5254-a7c7-c09dd15de559, skipping ID generation
2025-12-04 19:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 988e0459-29b3-5254-a7c7-c09dd15de559 with scrape type 1
2025-12-04 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 988e0459-29b3-5254-a7c7-c09dd15de559 from tracking dictionaries
2025-12-04 19:01:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 988e0459-29b3-5254-a7c7-c09dd15de559 sending to next pipeline
2025-12-04 19:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 988e0459-29b3-5254-a7c7-c09dd15de559, identifier: 117767385
2025-12-04 19:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 988e0459-29b3-5254-a7c7-c09dd15de559 with identifier: 117767385
2025-12-04 19:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 988e0459-29b3-5254-a7c7-c09dd15de559 with identifier: 117767385
2025-12-04 19:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 988e0459-29b3-5254-a7c7-c09dd15de559 with identifier: 117767385 to the API
2025-12-04 19:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '988e0459-29b3-5254-a7c7-c09dd15de559',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP66CFJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117767385',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 64548,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33784,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/0317816d-9635-4781-b497-761fbc755a99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30592,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/deba9d4d-f882-4734-a79c-b259c90a1b0f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27961,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/f992eb95-db1f-4b28-966b-34181dd5c44a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33369,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/795da7cf-62e0-452b-820a-ea00fb71a5fc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42975,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/4d1645a0-4431-4733-be7a-aa160c8bbd70_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44633,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/8ff2936e-9438-4e93-9cf8-2bcdd010048b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_988e0459-29b3-5254-a7c7-c09dd15de559/988e0459-29b3-5254-a7c7-c09dd15de559_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44759,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/AP66CFJ/2025-12-04/image/7adea3d5-18b6-4572-9ca1-b9b3acec3d4b_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': 'Manamanx Ltd',
 'title': 'FIAT 500 HATCHBACK 1.2 S 3dr',
 'transmission': 'manual',
 'trim': '1.2 S 3dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767385%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Saving data for 117767385: {'created_time': 1764874881.147792, 'last_price_update_time': 1764874881.147802, 'auction_closing_time': 1765215000.0}
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117767385') HTTP/1.1" 204 0
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Found listing with ID: 117599947
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599947%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Scrape type for 117599947: 0
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Found listing with ID: 117598161
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598161%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Scrape type for 117598161: 2
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117764042, 'registration': 'PE72ZRT', 'account': 'MOT070', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 X-Line S 5dr Auto', 'mileage': 7670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/23-2K 09/24-4K', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc735bba-5a56-4950-aafb-a8d1f74f00ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117764042, 'registration': 'PE72ZRT', 'account': 'MOT070', 'make': 'KIA', 'model': 'PICANTO HATCHBACK', 'derivative': '1.0 X-Line S 5dr Auto', 'mileage': 7670, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 09/23-2K 09/24-4K', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc735bba-5a56-4950-aafb-a8d1f74f00ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with identifier: 117764042
2025-12-04 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with scrape type 1
2025-12-04 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fa0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117491120, 'registration': 'EJ22CXG', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon 5dr CVT', 'mileage': 70500, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-05-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/29801c6c-b5b2-4a43-83ca-5492fb0c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/a330e8dc-29a3-4712-89fc-5b50a19fb2a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/007604be-bd71-4f98-97c3-1a1cb682d61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/c09e8925-e735-4cf1-9624-36fbc8ac91ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/77b8564f-388b-4ea1-afe2-57f02805d546_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/aafe9542-731d-429c-ad0e-ca4380eee23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/4274e07d-34cf-41fc-8f5c-15854b99bb96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/b3088252-a1e4-478d-a13f-6075e9ccf056_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/e70cebf9-7a00-4348-a799-dcd0035d2ab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/79f84e24-4f59-4bf0-a271-3d11842bd0c5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/23-22k 05/24-43k 05/25-59k', 'remarks': 'ADAPTIONS REMOVED - STEERING AID, vosa - 59k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20eeb127-ce6f-4320-8388-593a124b47d3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117491120, 'registration': 'EJ22CXG', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon 5dr CVT', 'mileage': 70500, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-05-27', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-05-26', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/29801c6c-b5b2-4a43-83ca-5492fb0c2ca3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/a330e8dc-29a3-4712-89fc-5b50a19fb2a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/007604be-bd71-4f98-97c3-1a1cb682d61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/c09e8925-e735-4cf1-9624-36fbc8ac91ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/77b8564f-388b-4ea1-afe2-57f02805d546_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/aafe9542-731d-429c-ad0e-ca4380eee23e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/4274e07d-34cf-41fc-8f5c-15854b99bb96_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/b3088252-a1e4-478d-a13f-6075e9ccf056_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/e70cebf9-7a00-4348-a799-dcd0035d2ab3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ22CXG/2025-12-02/image/79f84e24-4f59-4bf0-a271-3d11842bd0c5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/23-22k 05/24-43k 05/25-59k', 'remarks': 'ADAPTIONS REMOVED - STEERING AID, vosa - 59k', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/20eeb127-ce6f-4320-8388-593a124b47d3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8024b33f-2f61-5da7-b6b2-885132fc0de0 with identifier: 117491120
2025-12-04 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8024b33f-2f61-5da7-b6b2-885132fc0de0 with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8024b33f-2f61-5da7-b6b2-885132fc0de0 with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8024b33f-2f61-5da7-b6b2-885132fc0de0, identifier: 117491120
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117550109, 'registration': 'DF23VLZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22126, 'mileageWarranty': False, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/1824a405-609e-4a09-880d-7e9731bb761e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/88f1b398-0748-4560-b324-a3c1d284a94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/fed70155-c094-4167-b7b2-29c2a4442ad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/cd9319f9-b10c-4c74-bba2-418176a7b768_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/21d04c22-1480-4571-856b-af7d1f8031f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/d2b028d1-52db-49a0-a1c8-3cdc9af6ca3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/abdb0926-5781-4696-b103-8d2de3b9e07a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/2a50bca0-333d-4790-aaa7-429eab0b05de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/f59e5579-736a-4ed6-9870-9f6a181f0784_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/a370da89-b950-4103-be93-094eaef2307f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/4ab3e8f1-5c92-4bb9-9b4e-29ff98be6320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/6367688b-9b7b-43f2-92f4-d10c8c644d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/9adc3f41-356c-4f2e-a618-c057618f9714_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/2c19922b-d5c4-4be7-81ef-2659178651b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/0296877e-8b0e-4af7-ba65-1c9079149009_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/62a0511a-7254-45db-9a3b-f29c3b68dac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/1962d61f-e4cb-4e59-818f-04b556735eed_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25-19k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f3a077d-08fd-4f55-b856-cde7a9fa0d7b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117550109, 'registration': 'DF23VLZ', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 22126, 'mileageWarranty': False, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/1824a405-609e-4a09-880d-7e9731bb761e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/88f1b398-0748-4560-b324-a3c1d284a94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/fed70155-c094-4167-b7b2-29c2a4442ad7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/cd9319f9-b10c-4c74-bba2-418176a7b768_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/21d04c22-1480-4571-856b-af7d1f8031f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/d2b028d1-52db-49a0-a1c8-3cdc9af6ca3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/abdb0926-5781-4696-b103-8d2de3b9e07a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/2a50bca0-333d-4790-aaa7-429eab0b05de_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/f59e5579-736a-4ed6-9870-9f6a181f0784_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/a370da89-b950-4103-be93-094eaef2307f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/4ab3e8f1-5c92-4bb9-9b4e-29ff98be6320_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/6367688b-9b7b-43f2-92f4-d10c8c644d15_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/9adc3f41-356c-4f2e-a618-c057618f9714_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/2c19922b-d5c4-4be7-81ef-2659178651b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/0296877e-8b0e-4af7-ba65-1c9079149009_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/62a0511a-7254-45db-9a3b-f29c3b68dac0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23VLZ/2025-11-28/image/1962d61f-e4cb-4e59-818f-04b556735eed_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/25-19k', 'remarks': 'spare key', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3f3a077d-08fd-4f55-b856-cde7a9fa0d7b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-12-04 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2beed525-84c0-53df-923c-e6049e3dd55e with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2beed525-84c0-53df-923c-e6049e3dd55e with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2beed525-84c0-53df-923c-e6049e3dd55e, identifier: 117550109
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117374356, 'registration': 'WK72CVH', 'account': 'GRE064', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 33391, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WK72CVH/2025-11-21/image/74cc29ad-d62a-4835-9158-4938dfd321f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/a82de7de-b43b-42d1-a3f5-ae269c3e1dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/8352ac61-01c2-4ed0-9012-19fab1362b6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d502b410-9ff4-40da-957e-d508e604f83b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/55bf3844-56ad-4d3a-a9d3-abf39cdc96e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/fd180c8f-7c82-4c89-bec5-00de0ce59264_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/450acf7f-64ef-497d-bde3-184d33d91b8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/23d428f9-9852-4181-b332-6cf9fe7051fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/084b02dd-0bf3-4318-adc6-27e0530f8054_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d116b2ca-fd2b-4634-860b-0ec66cb88698_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d60fab8c-cf4e-4e9e-b28b-c8560e80cfee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/04b3a8b7-cbb3-43a5-bc71-c1528b7ba448_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/a40d11f1-75fe-440e-9613-8d91c52d2b36_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/c10be6b8-8e24-4add-b21f-cc25ad8eb078_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/da000202-c37f-4bf4-a44b-d29b2e0c20e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/c974bdc5-d0bf-4bd6-8c8e-76930e891290_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/5c6fbbc5-fa39-46a7-8ab3-051319d02ca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/cb4afb4b-985f-4cf9-9f67-0ec51327d6b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/0f3afa30-7a67-4b10-818a-9c6145ac7a31_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/210e9b03-1ce1-4527-92f1-f904b8a2c569_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/2b79dae1-5293-4073-84e1-7e488a28c61d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/24- 17k, 08/25- 33k', 'remarks': 'vosa@ 33k spare key', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b5193191-0615-449a-bfeb-d0265120756c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117374356, 'registration': 'WK72CVH', 'account': 'GRE064', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD', 'mileage': 33391, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-13', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WK72CVH/2025-11-21/image/74cc29ad-d62a-4835-9158-4938dfd321f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/a82de7de-b43b-42d1-a3f5-ae269c3e1dc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/8352ac61-01c2-4ed0-9012-19fab1362b6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d502b410-9ff4-40da-957e-d508e604f83b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/55bf3844-56ad-4d3a-a9d3-abf39cdc96e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/fd180c8f-7c82-4c89-bec5-00de0ce59264_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/450acf7f-64ef-497d-bde3-184d33d91b8d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/23d428f9-9852-4181-b332-6cf9fe7051fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/084b02dd-0bf3-4318-adc6-27e0530f8054_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d116b2ca-fd2b-4634-860b-0ec66cb88698_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/d60fab8c-cf4e-4e9e-b28b-c8560e80cfee_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/04b3a8b7-cbb3-43a5-bc71-c1528b7ba448_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/a40d11f1-75fe-440e-9613-8d91c52d2b36_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/c10be6b8-8e24-4add-b21f-cc25ad8eb078_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/da000202-c37f-4bf4-a44b-d29b2e0c20e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/c974bdc5-d0bf-4bd6-8c8e-76930e891290_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/5c6fbbc5-fa39-46a7-8ab3-051319d02ca1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/cb4afb4b-985f-4cf9-9f67-0ec51327d6b5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/0f3afa30-7a67-4b10-818a-9c6145ac7a31_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/210e9b03-1ce1-4527-92f1-f904b8a2c569_removebg.jpg?w=600', 'https://abimg003.imgix.net/WK72CVH/2025-11-21/image/2b79dae1-5293-4073-84e1-7e488a28c61d_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/24- 17k, 08/25- 33k', 'remarks': 'vosa@ 33k spare key', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b5193191-0615-449a-bfeb-d0265120756c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53858208-7cf4-5bbe-8c2a-c65354e66f06 with identifier: 117374356
2025-12-04 19:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53858208-7cf4-5bbe-8c2a-c65354e66f06 with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53858208-7cf4-5bbe-8c2a-c65354e66f06 with scrape type 2
2025-12-04 19:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53858208-7cf4-5bbe-8c2a-c65354e66f06, identifier: 117374356
2025-12-04 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117471399?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117610571?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117374439?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8024b33f-2f61-5da7-b6b2-885132fc0de0 with identifier: 117491120
2025-12-04 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8024b33f-2f61-5da7-b6b2-885132fc0de0 with identifier: 117491120
2025-12-04 19:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8024b33f-2f61-5da7-b6b2-885132fc0de0 with identifier: 117491120 to the API
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%278024b33f-2f61-5da7-b6b2-885132fc0de0%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 8024b33f-2f61-5da7-b6b2-885132fc0de0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117491120?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '8024b33f-2f61-5da7-b6b2-885132fc0de0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ22CXG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117491120',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORT',
 'odometer': 70500,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-27',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA COROLLA TOURING SPORT 1.8 VVT-i Hybrid Icon 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 VVT-i Hybrid Icon 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117491120%27 HTTP/1.1" 200 None
2025-12-04 19:01:21 [astonbarclay.gb] INFO: Saving data for 117491120: {'auction_closing_time': 1765275300.0, 'created_time': 1764097466.408795, 'last_price_update_time': 1764874881.915313}
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117491120') HTTP/1.1" 204 0
2025-12-04 19:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-12-04 19:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109
2025-12-04 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2beed525-84c0-53df-923c-e6049e3dd55e with identifier: 117550109 to the API
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272beed525-84c0-53df-923c-e6049e3dd55e%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2beed525-84c0-53df-923c-e6049e3dd55e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550109?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2beed525-84c0-53df-923c-e6049e3dd55e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23VLZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550109',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 22126,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550109%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Saving data for 117550109: {'auction_closing_time': 1764936000.0, 'created_time': 1764270150.137986, 'last_price_update_time': 1764874882.181093}
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550109') HTTP/1.1" 204 0
2025-12-04 19:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53858208-7cf4-5bbe-8c2a-c65354e66f06 with identifier: 117374356
2025-12-04 19:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53858208-7cf4-5bbe-8c2a-c65354e66f06 with identifier: 117374356
2025-12-04 19:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 53858208-7cf4-5bbe-8c2a-c65354e66f06 with identifier: 117374356 to the API
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117374356?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '53858208-7cf4-5bbe-8c2a-c65354e66f06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WK72CVH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374356',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 33391,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Greenhous Group',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 EcoBlue 190 ST-Line X Edition 5dr Auto '
          'AWD',
 'transmission': 'automatic',
 'trim': '2.0 EcoBlue 190 ST-Line X Edition 5dr Auto AWD',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374356%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Saving data for 117374356: {'auction_closing_time': 1764936000.0, 'created_time': 1763751762.681724, 'last_price_update_time': 1764874882.475248}
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117374356') HTTP/1.1" 204 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117665271
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117665271%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117665271: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 116895357
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116895357%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 116895357: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117475684
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117475684%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117475684: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585190
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585190%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585190: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585035
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585035%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585035: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117679523
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679523%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117679523: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117724459
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117724459%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117724459: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117164114
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117164114%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117164114: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117721727
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117721727%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117721727: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117699534
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699534%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117699534: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117584969
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584969%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117584969: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585151
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585151%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585151: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585083
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585083%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585083: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117584951
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584951%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117584951: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117584960
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117584960%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117584960: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585166
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585166%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585166: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585141
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585141%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585141: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585132
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585132%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585132: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585347
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585347%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585347: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117613099
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613099%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117613099: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117702364
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702364%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117702364: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585302
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585302%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585302: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117585284
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117585284%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117585284: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117661902
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661902%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117661902: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117366912
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366912%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117366912: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 116807925
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116807925%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 116807925: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117492135
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492135%27 HTTP/1.1" 200 None
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Scrape type for 117492135: 0
2025-12-04 19:01:22 [astonbarclay.gb] INFO: Found listing with ID: 117551156
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551156%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117551156: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117458552
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117458552%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117458552: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117571999
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117571999%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117571999: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117610728
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610728%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117610728: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117741358
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741358%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117741358: 1
2025-12-04 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117747534?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117600202
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600202%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117600202: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117737913
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737913%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117737913: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117737945
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737945%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117737945: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117737879
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737879%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117737879: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117767695
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767695%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117767695: 1
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117471399, 'registration': 'LV72UBN', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 17386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': 700, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72UBN/2025-12-02/image/f345b6a4-2b93-4cc2-b396-5de95318a3c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/45ad205e-ae92-4a03-bebc-36ad16899782_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/9dd23f33-5bc6-4199-ace5-5d8f136040ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/740e76d7-97c9-4cf3-98cd-fdc8bbfd9ef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/10d99253-54b9-4a1d-a762-63ebbf229910_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/fdad2903-55e6-4c5c-abf9-134edbe6ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/705a10cf-d404-4c73-84ba-224daea935d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/d594516a-bafd-4771-895e-edce6ad25ec6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/3c33080b-2e89-43af-9f57-95c2e3bcbd7f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24- 5k, 12/24- 13k', 'remarks': 'ADAPTIONS REMOVED - HOIST, spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666a4d98-a5da-4844-9bb6-59c23e626526.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117471399, 'registration': 'LV72UBN', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Exclusive 5dr DCT', 'mileage': 17386, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': 700, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72UBN/2025-12-02/image/f345b6a4-2b93-4cc2-b396-5de95318a3c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/45ad205e-ae92-4a03-bebc-36ad16899782_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/9dd23f33-5bc6-4199-ace5-5d8f136040ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/740e76d7-97c9-4cf3-98cd-fdc8bbfd9ef7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/10d99253-54b9-4a1d-a762-63ebbf229910_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/fdad2903-55e6-4c5c-abf9-134edbe6ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/705a10cf-d404-4c73-84ba-224daea935d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/d594516a-bafd-4771-895e-edce6ad25ec6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72UBN/2025-12-02/image/3c33080b-2e89-43af-9f57-95c2e3bcbd7f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24- 5k, 12/24- 13k', 'remarks': 'ADAPTIONS REMOVED - HOIST, spare key', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 174, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/666a4d98-a5da-4844-9bb6-59c23e626526.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-12-04 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with scrape type 2
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with scrape type 2
2025-12-04 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265, identifier: 117471399
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117610571, 'registration': 'DA18YTO', 'account': 'THE109', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT Line Premium 5dr', 'mileage': 91878, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-08-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA @ 47K 57K 72K 81K 89K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117610571, 'registration': 'DA18YTO', 'account': 'THE109', 'make': 'PEUGEOT', 'model': '5008 ESTATE', 'derivative': '1.2 PureTech GT Line Premium 5dr', 'mileage': 91878, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-08-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-09', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA @ 47K 57K 72K 81K 89K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1bf8696-7d23-529c-8930-c6d7587868f3 with identifier: 117610571
2025-12-04 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1bf8696-7d23-529c-8930-c6d7587868f3 with scrape type 1
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c1bf8696-7d23-529c-8930-c6d7587868f3
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c1bf8696-7d23-529c-8930-c6d7587868f3
2025-12-04 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c1bf8696-7d23-529c-8930-c6d7587868f3, identifier: 117610571
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117374439, 'registration': 'AX73OKZ', 'account': 'GRE064', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo 130 Ultimate 5dr Auto', 'mileage': 10448, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-02-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/9a4166d7-009c-464e-94f4-0f27c6d6f6e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/254fe49b-ee86-4f15-991c-9425aff3833d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/9e7e9a91-2e9e-4d64-9d02-aa8ab5e67f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/8402c48e-677c-4d40-ba01-2f11634886fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/d0a2d35f-1047-4dc7-ad2d-edf1645b6c17_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/74e9414a-8370-4afc-92d7-09b287b47812_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/741cd762-94cc-4a24-b701-0b1c474b4efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/b9a7f77e-0e46-4aed-afb6-ad86cad3ac19_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/25-10k', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48e6d99f-6012-49fe-aa09-92ba0a21455f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117374439, 'registration': 'AX73OKZ', 'account': 'GRE064', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.2 Turbo 130 Ultimate 5dr Auto', 'mileage': 10448, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2024-02-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/9a4166d7-009c-464e-94f4-0f27c6d6f6e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/254fe49b-ee86-4f15-991c-9425aff3833d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/9e7e9a91-2e9e-4d64-9d02-aa8ab5e67f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/8402c48e-677c-4d40-ba01-2f11634886fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/d0a2d35f-1047-4dc7-ad2d-edf1645b6c17_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/74e9414a-8370-4afc-92d7-09b287b47812_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/741cd762-94cc-4a24-b701-0b1c474b4efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX73OKZ/2025-11-21/image/b9a7f77e-0e46-4aed-afb6-ad86cad3ac19_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 08/25-10k', 'remarks': 'spare key in office', 'virtual': False, 'seller': 'Greenhous Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/48e6d99f-6012-49fe-aa09-92ba0a21455f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with identifier: 117374439
2025-12-04 19:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with scrape type 2
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with scrape type 2
2025-12-04 19:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3fd7515d-ffbd-5de5-9feb-fc2dd332f067, identifier: 117374439
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117733240
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733240%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117733240: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117247051
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117247051%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117247051: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117604369
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117604369%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117604369: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117697673
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117697673%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117697673: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 60238390
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2760238390%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 60238390: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117547822
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547822%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117547822: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117547832
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547832%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117547832: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117366549
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117366549%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117366549: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 116891417
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116891417%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 116891417: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 116288981
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116288981%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 116288981: 0
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Found listing with ID: 117748030
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117748030%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [astonbarclay.gb] INFO: Scrape type for 117748030: 1
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-12-04 19:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399
2025-12-04 19:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265 with identifier: 117471399 to the API
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117471399?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 174,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '9bf3a7d5-f69c-5ae8-aa38-a3b99a4b6265',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV72UBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117471399',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 17386,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-30',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.5 T-GDI Exclusive 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117471399%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Saving data for 117471399: {'auction_closing_time': 1765275300.0, 'created_time': 1764061254.425599, 'last_price_update_time': 1764874884.020717}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117471399') HTTP/1.1" 204 0
2025-12-04 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c1bf8696-7d23-529c-8930-c6d7587868f3 with identifier: 117610571
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c1bf8696-7d23-529c-8930-c6d7587868f3 with identifier: 117610571
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 147862 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147862
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: c1bf8696-7d23-529c-8930-c6d7587868f3 spider: astonbarclay.gb
2025-12-04 19:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c1bf8696-7d23-529c-8930-c6d7587868f3 due to rule: high_mileage_for_make.json, error: 147862 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    147862
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'c1bf8696-7d23-529c-8930-c6d7587868f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DA18YTO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117610571',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '5008 ESTATE',
 'odometer': 91878,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-11',
 'seller_name': 'TCB Group - Prime',
 'title': 'PEUGEOT 5008 ESTATE 1.2 PureTech GT Line Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech GT Line Premium 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117610571%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Saving data for 117610571: {'created_time': 1764874884.332868, 'last_price_update_time': 1764874884.332878, 'auction_closing_time': 1765275300.0}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117610571') HTTP/1.1" 204 0
2025-12-04 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with identifier: 117374439
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with identifier: 117374439
2025-12-04 19:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3fd7515d-ffbd-5de5-9feb-fc2dd332f067 with identifier: 117374439 to the API
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117374439?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3fd7515d-ffbd-5de5-9feb-fc2dd332f067',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AX73OKZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374439',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 10448,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-19',
 'seller_name': 'Greenhous Group',
 'title': 'VAUXHALL CORSA HATCHBACK 1.2 Turbo 130 Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo 130 Ultimate 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374439%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Saving data for 117374439: {'auction_closing_time': 1764936000.0, 'created_time': 1763751758.240775, 'last_price_update_time': 1764874884.611608}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117374439') HTTP/1.1" 204 0
2025-12-04 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117747534, 'registration': 'GV70XVO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE ESTATE', 'derivative': '1.2 Turbo 130 SE 5dr Auto', 'mileage': 40009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-02-15', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 01/22-8K 06/23-14K 06/24-26K 07/25-34K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117747534, 'registration': 'GV70XVO', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'COMBO LIFE ESTATE', 'derivative': '1.2 Turbo 130 SE 5dr Auto', 'mileage': 40009, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-02-15', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 01/22-8K 06/23-14K 06/24-26K 07/25-34K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': 'TF', 'co2': 153, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f36fc362-aa45-5d37-ab60-36dde9cdcc9e with identifier: 117747534
2025-12-04 19:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f36fc362-aa45-5d37-ab60-36dde9cdcc9e with scrape type 1
2025-12-04 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f36fc362-aa45-5d37-ab60-36dde9cdcc9e
2025-12-04 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f36fc362-aa45-5d37-ab60-36dde9cdcc9e
2025-12-04 19:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f36fc362-aa45-5d37-ab60-36dde9cdcc9e, identifier: 117747534
2025-12-04 19:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117747182
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117747182%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117747182: 0
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117637760
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117637760%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117637760: 0
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Found listing with ID: 117743313
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743313%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Scrape type for 117743313: 1
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f36fc362-aa45-5d37-ab60-36dde9cdcc9e with identifier: 117747534
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f36fc362-aa45-5d37-ab60-36dde9cdcc9e with identifier: 117747534
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life estate' containing 'combo'
2025-12-04 19:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: f36fc362-aa45-5d37-ab60-36dde9cdcc9e spider: astonbarclay.gb
2025-12-04 19:01:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f36fc362-aa45-5d37-ab60-36dde9cdcc9e due to rule: makes_models_not_allowed.json, error: Rejected due to make 'vauxhall' containing 'vauxhall' and model 'combo life estate' containing 'combo'
{'auction_title': '',
 'c_o_2_emission_value': 153,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'f36fc362-aa45-5d37-ab60-36dde9cdcc9e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GV70XVO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117747534',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'COMBO LIFE ESTATE',
 'odometer': 40009,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-15',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL COMBO LIFE ESTATE 1.2 Turbo 130 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo 130 SE 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117747534%27 HTTP/1.1" 200 None
2025-12-04 19:01:24 [astonbarclay.gb] INFO: Saving data for 117747534: {'created_time': 1764874884.993133, 'last_price_update_time': 1764874884.993144, 'auction_closing_time': 1765275300.0}
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117747534') HTTP/1.1" 204 0
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117743353
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743353%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117743353: 1
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117743322
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743322%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117743322: 1
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Feae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48d6550>
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fa0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd599d750>
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Found listing with ID: 117743298
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743298%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [astonbarclay.gb] INFO: Scrape type for 117743298: 1
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fd86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bc0fd0>
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48b4490>
2025-12-04 19:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117616509
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117616509%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117616509: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117743439
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743439%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117743439: 1
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117743430
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743430%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117743430: 1
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116617318?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117293082?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117768238?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117144960?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117600700
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600700%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117600700: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117743417
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743417%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117743417: 1
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117600618
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600618%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117600618: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117599975
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599975%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117599975: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117700553
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700553%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117700553: 1
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a1f8d0>
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117599932
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599932%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117599932: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117661933
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661933%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117661933: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117646620
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117646620%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117646620: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117644920
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117644920%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117644920: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117627838
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117627838%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117627838: 0
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Found listing with ID: 117749600
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117749600%27 HTTP/1.1" 200 None
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Scrape type for 117749600: 1
2025-12-04 19:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116617318, 'registration': 'HS16FWW', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr', 'mileage': 98867, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16FWW/2025-10-24/image/5984fd43-b91e-41fb-9d26-7f8a26e9a75d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/20c35d4d-31ad-43ce-a188-c6870be5575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/e332be3b-e053-43c4-a40e-7b5eea278cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/fa8f3acb-4fd1-4b60-81b1-1f6ceb28fe1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/57337dea-1936-463f-aa57-f5db6d0cd64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/99d2f96e-8b10-49bc-a02f-cc1de905e1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/caa110d3-3848-433e-81f5-d8de4fa1802f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/79693944-41e7-4bf2-9696-cefc98dce830_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/18 21K 12/18 45K', 'remarks': 'VOSA STATES 59K 73K 79K 87K 92K 97K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60a25621-1906-4a9e-ad06-d6747fd76cb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116617318, 'registration': 'HS16FWW', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr', 'mileage': 98867, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-07-27', 'fuel': 'Diesel', 'motExpiry': '2026-07-25', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HS16FWW/2025-10-24/image/5984fd43-b91e-41fb-9d26-7f8a26e9a75d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/20c35d4d-31ad-43ce-a188-c6870be5575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/e332be3b-e053-43c4-a40e-7b5eea278cf8_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/fa8f3acb-4fd1-4b60-81b1-1f6ceb28fe1a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/57337dea-1936-463f-aa57-f5db6d0cd64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/99d2f96e-8b10-49bc-a02f-cc1de905e1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/caa110d3-3848-433e-81f5-d8de4fa1802f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HS16FWW/2025-10-24/image/79693944-41e7-4bf2-9696-cefc98dce830_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/18 21K 12/18 45K', 'remarks': 'VOSA STATES 59K 73K 79K 87K 92K 97K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60a25621-1906-4a9e-ad06-d6747fd76cb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2025-12-04 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with scrape type 2
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with scrape type 2
2025-12-04 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3, identifier: 116617318
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117293082, 'registration': 'KN71UFB', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 10533, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KN71UFB/2025-11-25/image/dac7bb97-c09a-4f75-b003-91e932e2ec87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/48a1e3fc-44ad-4d4d-a4aa-8551aae291e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/44d7bb36-5efc-43da-8980-ac240ad1b2fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/741f9c24-ce9a-4565-9f5a-4bf5bebfe461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/6f5ac7b8-a0b7-44da-b6fd-debc1718c233_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/aec1073a-a8f1-4c90-a64a-8299cfff50ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/0b6d04f7-e8e8-43fc-be38-28f48cf598aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/403f9218-0fbc-4900-b1df-6037e64436e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/43676fdc-d9a1-4251-99d8-3153ad7d009f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/140bdd51-f66d-407f-9423-4128afa4762f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23- 3k, 01/24- 5k, 12/24- 8k', 'remarks': 'ADAPTIONS REMOVED - HAND CONTROLS vosa - 8k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3951cad-49a4-4186-a622-fa6b7c335073.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117293082, 'registration': 'KN71UFB', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 10533, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-01-11', 'fuel': 'Petrol', 'motExpiry': '2026-01-10', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KN71UFB/2025-11-25/image/dac7bb97-c09a-4f75-b003-91e932e2ec87_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/48a1e3fc-44ad-4d4d-a4aa-8551aae291e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/44d7bb36-5efc-43da-8980-ac240ad1b2fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/741f9c24-ce9a-4565-9f5a-4bf5bebfe461_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/6f5ac7b8-a0b7-44da-b6fd-debc1718c233_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/aec1073a-a8f1-4c90-a64a-8299cfff50ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/0b6d04f7-e8e8-43fc-be38-28f48cf598aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/403f9218-0fbc-4900-b1df-6037e64436e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/43676fdc-d9a1-4251-99d8-3153ad7d009f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KN71UFB/2025-11-25/image/140bdd51-f66d-407f-9423-4128afa4762f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 01/23- 3k, 01/24- 5k, 12/24- 8k', 'remarks': 'ADAPTIONS REMOVED - HAND CONTROLS vosa - 8k spare key in office', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3951cad-49a4-4186-a622-fa6b7c335073.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-12-04 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8114833-4e43-522c-a956-8fdb9e93a239 with scrape type 2
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8114833-4e43-522c-a956-8fdb9e93a239 with scrape type 2
2025-12-04 19:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c8114833-4e43-522c-a956-8fdb9e93a239, identifier: 117293082
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117768238, 'registration': 'PF74HJN', 'account': 'MOT070', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 13569, 'mileageWarranty': False, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-12-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117768238, 'registration': 'PF74HJN', 'account': 'MOT070', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 13569, 'mileageWarranty': False, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2024-12-12', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb with identifier: 117768238
2025-12-04 19:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb with scrape type 1
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb
2025-12-04 19:01:26 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb
2025-12-04 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb, identifier: 117768238
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117144960, 'registration': 'WR67AOM', 'account': 'HEN022', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 57509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR67AOM/2025-11-14/image/07d2e941-4745-4c1d-9bf8-98e2188bbf15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/af3fc004-54f9-4bcb-a7d5-0bb81458576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/33aab69b-13e7-404f-a8d8-5b5bc5ed2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/86f5550c-a655-48dc-9b47-6ba99a8e62cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/cff63b2d-8104-4cf7-aef4-c8825206db90_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/3a0b1fc0-d3af-42b0-a23d-ca6cd74eab8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/5174e5c4-0fe5-4055-a9a9-ba97b45b63f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/006b2a73-48aa-4f2f-889d-b1eebb23590b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18-10K, 08/19-20K, 12/20-29K, 10/21-36K, 10/22-44K, 10/23-47K, 10/24-51K, 10/25-57K', 'remarks': 'SPARE KEY, VOSA STATES 28K 36K 44K 47K 51K 57K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67f72cdd-105e-46e2-90e2-36ed4ce04ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117144960, 'registration': 'WR67AOM', 'account': 'HEN022', 'make': 'FIAT', 'model': '500 HATCHBACK', 'derivative': '1.2 Lounge 3dr', 'mileage': 57509, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-09-29', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 3, 'engineSize': 1242, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WR67AOM/2025-11-14/image/07d2e941-4745-4c1d-9bf8-98e2188bbf15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/af3fc004-54f9-4bcb-a7d5-0bb81458576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/33aab69b-13e7-404f-a8d8-5b5bc5ed2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/86f5550c-a655-48dc-9b47-6ba99a8e62cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/cff63b2d-8104-4cf7-aef4-c8825206db90_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/3a0b1fc0-d3af-42b0-a23d-ca6cd74eab8f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/5174e5c4-0fe5-4055-a9a9-ba97b45b63f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WR67AOM/2025-11-14/image/006b2a73-48aa-4f2f-889d-b1eebb23590b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/18-10K, 08/19-20K, 12/20-29K, 10/21-36K, 10/22-44K, 10/23-47K, 10/24-51K, 10/25-57K', 'remarks': 'SPARE KEY, VOSA STATES 28K 36K 44K 47K 51K 57K', 'virtual': False, 'seller': 'Car360', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/67f72cdd-105e-46e2-90e2-36ed4ce04ed0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-04 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec14c2d4-230a-52da-bb7d-a917bffc5c97 with scrape type 2
2025-12-04 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec14c2d4-230a-52da-bb7d-a917bffc5c97 with scrape type 2
2025-12-04 19:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec14c2d4-230a-52da-bb7d-a917bffc5c97, identifier: 117144960
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117740877, 'registration': 'MT65OEO', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 SRi 5dr', 'mileage': 92524, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-16', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 11K 07/19 20K 09/20 28K 08/23 54K', 'remarks': 'VOSA STATES 24K 32K 40K 49K 63K 66K 80K 84K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '7', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/611a8fa4-aba6-4ee6-b090-49f4feff26f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117740877, 'registration': 'MT65OEO', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.4T 16V 150 SRi 5dr', 'mileage': 92524, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-16', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1399, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600', 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/18 11K 07/19 20K 09/20 28K 08/23 54K', 'remarks': 'VOSA STATES 24K 32K 40K 49K 63K 66K 80K 84K', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '7', 'v5': False, 'v5details': None, 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/611a8fa4-aba6-4ee6-b090-49f4feff26f9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3a4e0abc-3579-540b-9555-6d8c393645b8 with identifier: 117740877
2025-12-04 19:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4e0abc-3579-540b-9555-6d8c393645b8 with scrape type 1
2025-12-04 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Found listing with ID: 117576600
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Scrape type for 117576600: 2
2025-12-04 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2025-12-04 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 with identifier: 116617318
2025-12-04 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159110 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159110
2025-12-04 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 spider: astonbarclay.gb
2025-12-04 19:01:27 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6cccaf5b-b4bc-5055-8624-499a5dfeecf3 due to rule: high_mileage_for_country.json, error: 159110 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159110
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6cccaf5b-b4bc-5055-8624-499a5dfeecf3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HS16FWW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116617318',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 98867,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-27',
 'seller_name': 'Zuto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr',
 'transmission': 'manual',
 'trim': '2.0 TD4 SE Tech 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116617318%27 HTTP/1.1" 200 None
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Saving data for 116617318: {'auction_closing_time': 1765274400.0, 'created_time': 1764097570.095845, 'last_price_update_time': 1764874887.354273}
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116617318') HTTP/1.1" 204 0
2025-12-04 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-12-04 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082
2025-12-04 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c8114833-4e43-522c-a956-8fdb9e93a239 with identifier: 117293082 to the API
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117293082?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c8114833-4e43-522c-a956-8fdb9e93a239',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KN71UFB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117293082',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 10533,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-01-11',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117293082%27 HTTP/1.1" 200 None
2025-12-04 19:01:27 [astonbarclay.gb] INFO: Saving data for 117293082: {'auction_closing_time': 1764936000.0, 'created_time': 1763492856.155598, 'last_price_update_time': 1764874887.819337}
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117293082') HTTP/1.1" 204 0
2025-12-04 19:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb with identifier: 117768238
2025-12-04 19:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb with identifier: 117768238
2025-12-04 19:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb with identifier: 117768238 to the API
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb%27 HTTP/1.1" 200 None
2025-12-04 19:01:28 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:27 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117768238?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'b6eada9f-e727-56d2-9e9e-9ba0b5dfcaeb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PF74HJN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768238',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 13569,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-12',
 'seller_name': 'Motability Operations',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'vin': None,
 'year': 2024}
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768238%27 HTTP/1.1" 200 None
2025-12-04 19:01:28 [astonbarclay.gb] INFO: Saving data for 117768238: {'created_time': 1764874888.10914, 'last_price_update_time': 1764874888.109151, 'auction_closing_time': 1765275300.0}
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117768238') HTTP/1.1" 204 0
2025-12-04 19:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-04 19:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960
2025-12-04 19:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ec14c2d4-230a-52da-bb7d-a917bffc5c97 with identifier: 117144960 to the API
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117144960?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ec14c2d4-230a-52da-bb7d-a917bffc5c97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WR67AOM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117144960',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FIAT',
 'model': '500 HATCHBACK',
 'odometer': 57509,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-29',
 'seller_name': 'Car360',
 'title': 'FIAT 500 HATCHBACK 1.2 Lounge 3dr',
 'transmission': 'manual',
 'trim': '1.2 Lounge 3dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117144960%27 HTTP/1.1" 200 None
2025-12-04 19:01:28 [astonbarclay.gb] INFO: Saving data for 117144960: {'auction_closing_time': 1765274400.0, 'created_time': 1763147190.858059, 'last_price_update_time': 1764874888.428182}
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117144960') HTTP/1.1" 204 0
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59aa550>
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Fd86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:01:28 [astonbarclay.gb] INFO: Found listing with ID: 115431227
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-12-04 19:01:28 [astonbarclay.gb] INFO: Scrape type for 115431227: 2
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c77d90>
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48990d0>
2025-12-04 19:01:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fa154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 117661782
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661782%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Scrape type for 117661782: 2
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117769180?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bde3d0>
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_10.jpg HTTP/1.1" 201 0
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 117576849
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Scrape type for 117576849: 2
2025-12-04 19:01:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 116671419
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Scrape type for 116671419: 2
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Found listing with ID: 117634437
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634437%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Scrape type for 117634437: 2
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117769180, 'registration': 'CA70ANF', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 41433, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/21-8K 12/22-19K 11/23-28K 10/24-34K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117769180, 'registration': 'CA70ANF', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 41433, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-16', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/21-8K 12/22-19K 11/23-28K 10/24-34K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40c82f56-d3b8-5508-9cc8-cf5705640883 with identifier: 117769180
2025-12-04 19:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40c82f56-d3b8-5508-9cc8-cf5705640883 with scrape type 1
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 40c82f56-d3b8-5508-9cc8-cf5705640883
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 40c82f56-d3b8-5508-9cc8-cf5705640883
2025-12-04 19:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 40c82f56-d3b8-5508-9cc8-cf5705640883, identifier: 117769180
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fb25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 40c82f56-d3b8-5508-9cc8-cf5705640883 with identifier: 117769180
2025-12-04 19:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 40c82f56-d3b8-5508-9cc8-cf5705640883 with identifier: 117769180
2025-12-04 19:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 40c82f56-d3b8-5508-9cc8-cf5705640883 with identifier: 117769180 to the API
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2740c82f56-d3b8-5508-9cc8-cf5705640883%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 40c82f56-d3b8-5508-9cc8-cf5705640883: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:29 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117769180?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Diesel',
 'id': '40c82f56-d3b8-5508-9cc8-cf5705640883',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CA70ANF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117769180',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PEUGEOT',
 'model': '3008 DIESEL ESTATE',
 'odometer': 41433,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-24',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 DIESEL ESTATE 1.5 BlueHDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117769180%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Saving data for 117769180: {'created_time': 1764874890.066519, 'last_price_update_time': 1764874890.066529, 'auction_closing_time': 1765275300.0}
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117769180') HTTP/1.1" 204 0
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 116989244
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 116989244: 2
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fcea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 116134889
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 116134889: 2
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507292?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117766803?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117598161?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117623566?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117700684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Ff7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117288965
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117288965: 2
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117330721
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117330721: 2
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117600158
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600158%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117600158: 0
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117600051
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117600051%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117600051: 0
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 114089759
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 114089759: 2
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117688221
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688221%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117688221: 0
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 116755943
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 116755943: 2
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117730170
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117730170%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117730170: 0
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Found listing with ID: 117131550
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Scrape type for 117131550: 2
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a71810>
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117507292, 'registration': 'DF23WFN', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 28961, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23WFN/2025-11-28/image/c3b4ac7c-b8b1-469a-9aa6-66986f479d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/e5ebf4e1-6b35-42b6-80c3-0673f2f3ea96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/b6fd46a5-9b09-464a-9505-9630ceaf5e85_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/41d327f3-d193-4695-8828-789c8201fddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/52bae396-7a79-4e93-a641-8d333749608a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/7e3cdf43-fbac-48cc-a609-70088143b433_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/fec3eb4d-8eac-4b16-976c-4cd0672f1bab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/15f024f6-4eed-4b10-97ff-f107d3ed7f95_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/4abfbb83-335e-421f-ad5e-f8d467f5e68a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/b6b1900f-8411-435d-b177-286e4bd53d0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/89455725-a40a-4066-9a92-a5ba9b2662ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/dc8f0bf8-2813-43ac-9a5b-c75522a2e56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/ccdffc3f-f7ac-4c15-9ef0-35734b49af83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/c35883d3-df80-4ab7-8fba-cfc65cd34ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/0df0195f-8899-4a5a-9bbc-c7cda1a77ff2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 03/25-18K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/783489d4-2f7a-4344-85cd-58c643e8e086.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117507292, 'registration': 'DF23WFN', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 28961, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2023-07-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DF23WFN/2025-11-28/image/c3b4ac7c-b8b1-469a-9aa6-66986f479d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/e5ebf4e1-6b35-42b6-80c3-0673f2f3ea96_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/b6fd46a5-9b09-464a-9505-9630ceaf5e85_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/41d327f3-d193-4695-8828-789c8201fddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/52bae396-7a79-4e93-a641-8d333749608a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/7e3cdf43-fbac-48cc-a609-70088143b433_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/fec3eb4d-8eac-4b16-976c-4cd0672f1bab_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/15f024f6-4eed-4b10-97ff-f107d3ed7f95_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/4abfbb83-335e-421f-ad5e-f8d467f5e68a_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/b6b1900f-8411-435d-b177-286e4bd53d0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/89455725-a40a-4066-9a92-a5ba9b2662ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/dc8f0bf8-2813-43ac-9a5b-c75522a2e56b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/ccdffc3f-f7ac-4c15-9ef0-35734b49af83_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/c35883d3-df80-4ab7-8fba-cfc65cd34ad8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DF23WFN/2025-11-28/image/0df0195f-8899-4a5a-9bbc-c7cda1a77ff2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 03/25-18K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/783489d4-2f7a-4344-85cd-58c643e8e086.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cfd0e66-8a31-5033-b22c-0200a48c3705 with identifier: 117507292
2025-12-04 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cfd0e66-8a31-5033-b22c-0200a48c3705 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cfd0e66-8a31-5033-b22c-0200a48c3705 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5cfd0e66-8a31-5033-b22c-0200a48c3705, identifier: 117507292
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117766803, 'registration': 'BF72KVE', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.5 TSI SE Drive 5dr DSG', 'mileage': 17887, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24-10K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117766803, 'registration': 'BF72KVE', 'account': 'MOT070', 'make': 'SKODA', 'model': 'KAMIQ HATCHBACK', 'derivative': '1.5 TSI SE Drive 5dr DSG', 'mileage': 17887, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-09T10:15Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24-10K', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23ae6169-65f6-55be-b831-236f5683b6e3 with identifier: 117766803
2025-12-04 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23ae6169-65f6-55be-b831-236f5683b6e3 with scrape type 1
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 23ae6169-65f6-55be-b831-236f5683b6e3
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 23ae6169-65f6-55be-b831-236f5683b6e3
2025-12-04 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 23ae6169-65f6-55be-b831-236f5683b6e3, identifier: 117766803
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117598161, 'registration': 'SA18LWD', 'account': 'SPE034', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T ecoTEC Active 5dr', 'mileage': 78296, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-27', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 39K, 47K, 60K, 66K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117598161, 'registration': 'SA18LWD', 'account': 'SPE034', 'make': 'VAUXHALL', 'model': 'MOKKA X HATCHBACK', 'derivative': '1.4T ecoTEC Active 5dr', 'mileage': 78296, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-27', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 32K, 39K, 47K, 60K, 66K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with identifier: 117598161
2025-12-04 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2b617fea-a6a3-5ca9-b30b-e06bafa59d06, identifier: 117598161
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117623566, 'registration': 'BD21MYB', 'account': 'MOT075', 'make': 'FORD', 'model': 'FOCUS ESTATE', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr', 'mileage': 110888, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-11', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD21MYB/2025-12-02/image/2ad6a6fc-fe88-439f-b397-e604b6767a63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/36673b5b-6b78-4bb8-8579-d442d2077cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/2f9dbae3-5cbb-486b-8814-4ede82d5ca90_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/979a1198-8384-4de8-b9df-fb64b56dbaa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/f5a54a3a-fd48-4242-a2db-f5359cd39d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/f6ead466-df1e-44a4-b152-5e019b86aa90_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/3534d70d-78cd-4e88-af88-57a9c9de86a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/fd022e8a-cc89-421b-b552-2dd45b69c09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/d35d1151-ad99-4e81-b40c-128329aab64b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/21-19K, 08/22-47K, 03/23-67K, 11/23-88K, 08/24-101K', 'remarks': 'SPARE KEY, VOSA STATES 100K 106K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99c2c347-1af9-4bfe-832e-8e9c89858f74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117623566, 'registration': 'BD21MYB', 'account': 'MOT075', 'make': 'FORD', 'model': 'FOCUS ESTATE', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr', 'mileage': 110888, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-06-11', 'fuel': 'Petrol', 'motExpiry': '2026-06-11', 'doors': 5, 'engineSize': 999, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BD21MYB/2025-12-02/image/2ad6a6fc-fe88-439f-b397-e604b6767a63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/36673b5b-6b78-4bb8-8579-d442d2077cd6_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/2f9dbae3-5cbb-486b-8814-4ede82d5ca90_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/979a1198-8384-4de8-b9df-fb64b56dbaa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/f5a54a3a-fd48-4242-a2db-f5359cd39d3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/f6ead466-df1e-44a4-b152-5e019b86aa90_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/3534d70d-78cd-4e88-af88-57a9c9de86a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/fd022e8a-cc89-421b-b552-2dd45b69c09a_removebg.jpg?w=600', 'https://abimg003.imgix.net/BD21MYB/2025-12-02/image/d35d1151-ad99-4e81-b40c-128329aab64b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 12/21-19K, 08/22-47K, 03/23-67K, 11/23-88K, 08/24-101K', 'remarks': 'SPARE KEY, VOSA STATES 100K 106K', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/99c2c347-1af9-4bfe-832e-8e9c89858f74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 with identifier: 117623566
2025-12-04 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 with scrape type 2
2025-12-04 19:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3, identifier: 117623566
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117700684, 'registration': 'VN65HPV', 'account': 'THE109', 'make': 'SKODA', 'model': 'SUPERB DIESEL ESTATE', 'derivative': '2.0 TDI CR 190 Laurin + Klement 5dr DSG', 'mileage': 125671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-14', 'fuel': 'Diesel', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 09/18 29K 06/19 39K  01/20 48K 11/20 58K  1/21 67K 07/22 76K 11/23 97K 07/24 107K', 'remarks': 'SPARE KEY VOSA STATES 32K 46K 59K 69K 83K 100K 114K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73a75ea8-eadb-47e0-8cc7-9ca6358051f0.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117700684, 'registration': 'VN65HPV', 'account': 'THE109', 'make': 'SKODA', 'model': 'SUPERB DIESEL ESTATE', 'derivative': '2.0 TDI CR 190 Laurin + Klement 5dr DSG', 'mileage': 125671, 'mileageWarranty': True, 'type': 'car', 'saleId': 17981, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-01-14', 'fuel': 'Diesel', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 09/18 29K 06/19 39K  01/20 48K 11/20 58K  1/21 67K 07/22 76K 11/23 97K 07/24 107K', 'remarks': 'SPARE KEY VOSA STATES 32K 46K 59K 69K 83K 100K 114K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73a75ea8-eadb-47e0-8cc7-9ca6358051f0.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49672b21-88c2-5c8e-9558-7d02c72e7cab with identifier: 117700684
2025-12-04 19:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49672b21-88c2-5c8e-9558-7d02c72e7cab with scrape type 1
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 49672b21-88c2-5c8e-9558-7d02c72e7cab
2025-12-04 19:01:30 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 49672b21-88c2-5c8e-9558-7d02c72e7cab
2025-12-04 19:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49672b21-88c2-5c8e-9558-7d02c72e7cab, identifier: 117700684
2025-12-04 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117702797
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702797%27 HTTP/1.1" 200 None
2025-12-04 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117702797: 0
2025-12-04 19:01:31 [astonbarclay.gb] INFO: Found listing with ID: 117175645
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-12-04 19:01:31 [astonbarclay.gb] INFO: Scrape type for 117175645: 2
2025-12-04 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5cfd0e66-8a31-5033-b22c-0200a48c3705 with identifier: 117507292
2025-12-04 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5cfd0e66-8a31-5033-b22c-0200a48c3705 with identifier: 117507292
2025-12-04 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5cfd0e66-8a31-5033-b22c-0200a48c3705 with identifier: 117507292 to the API
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275cfd0e66-8a31-5033-b22c-0200a48c3705%27 HTTP/1.1" 200 None
2025-12-04 19:01:31 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5cfd0e66-8a31-5033-b22c-0200a48c3705: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:30 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507292?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5cfd0e66-8a31-5033-b22c-0200a48c3705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DF23WFN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507292',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 28961,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-24',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507292%27 HTTP/1.1" 200 None
2025-12-04 19:01:31 [astonbarclay.gb] INFO: Saving data for 117507292: {'auction_closing_time': 1764936000.0, 'created_time': 1764097474.412464, 'last_price_update_time': 1764874891.750096}
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507292') HTTP/1.1" 204 0
2025-12-04 19:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 23ae6169-65f6-55be-b831-236f5683b6e3 with identifier: 117766803
2025-12-04 19:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 23ae6169-65f6-55be-b831-236f5683b6e3 with identifier: 117766803
2025-12-04 19:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 23ae6169-65f6-55be-b831-236f5683b6e3 with identifier: 117766803 to the API
2025-12-04 19:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2723ae6169-65f6-55be-b831-236f5683b6e3%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 23ae6169-65f6-55be-b831-236f5683b6e3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117766803?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': '23ae6169-65f6-55be-b831-236f5683b6e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BF72KVE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117766803',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'SKODA',
 'model': 'KAMIQ HATCHBACK',
 'odometer': 17887,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seller_name': 'Motability Operations',
 'title': 'SKODA KAMIQ HATCHBACK 1.5 TSI SE Drive 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI SE Drive 5dr DSG',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117766803%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Saving data for 117766803: {'created_time': 1764874892.186498, 'last_price_update_time': 1764874892.186509, 'auction_closing_time': 1765275300.0}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117766803') HTTP/1.1" 204 0
2025-12-04 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with identifier: 117598161
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with identifier: 117598161
2025-12-04 19:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2b617fea-a6a3-5ca9-b30b-e06bafa59d06 with identifier: 117598161 to the API
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272b617fea-a6a3-5ca9-b30b-e06bafa59d06%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2b617fea-a6a3-5ca9-b30b-e06bafa59d06: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117598161?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2b617fea-a6a3-5ca9-b30b-e06bafa59d06',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA18LWD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117598161',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'MOKKA X HATCHBACK',
 'odometer': 78296,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-30',
 'seller_name': 'SVP Ltd',
 'title': 'VAUXHALL MOKKA X HATCHBACK 1.4T ecoTEC Active 5dr',
 'transmission': 'manual',
 'trim': '1.4T ecoTEC Active 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598161%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Saving data for 117598161: {'auction_closing_time': 1765285200.0, 'created_time': 1764356510.626966, 'last_price_update_time': 1764874892.509356}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117598161') HTTP/1.1" 204 0
2025-12-04 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 with identifier: 117623566
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 with identifier: 117623566
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 178456 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178456
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 spider: astonbarclay.gb
2025-12-04 19:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9c30a951-a91f-527e-ae3a-13ec2d47c4c3 due to rule: high_mileage_for_country.json, error: 178456 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    178456
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9c30a951-a91f-527e-ae3a-13ec2d47c4c3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BD21MYB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117623566',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'FORD',
 'model': 'FOCUS ESTATE',
 'odometer': 110888,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-11',
 'seller_name': 'MotoNovo Finance',
 'title': 'FORD FOCUS ESTATE 1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Edition 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623566%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Saving data for 117623566: {'auction_closing_time': 1765274400.0, 'created_time': 1764666054.034225, 'last_price_update_time': 1764874892.722511}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117623566') HTTP/1.1" 204 0
2025-12-04 19:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49672b21-88c2-5c8e-9558-7d02c72e7cab with identifier: 117700684
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49672b21-88c2-5c8e-9558-7d02c72e7cab with identifier: 117700684
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'skoda superb diesel estate 2.0 tdi cr 190 laurin + klement 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'superb diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 125671, 'odometer_reading_unit': 'mi', 'registration_date': '2016-01-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700684', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr 190 laurin + klement 5dr dsg', 'license_plate': 'vn65hpv', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '49672b21-88c2-5c8e-9558-7d02c72e7cab', 'current_year_diff': 9, 'age_in_months': 118, 'make_model': 'skoda superb diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 202247}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 118,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'diesel',
     'id': '49672b21-88c2-5c8e-9558-7d02c72e7cab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vn65hpv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700684',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'skoda',
     'make_model': 'skoda superb diesel estate',
     'model': 'superb diesel estate',
     'odometer': 125671,
     'odometer_in_km': 202247,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-01-14',
     'sanitized_make': 'skoda',
     'seller_name': 'tcb group - prime',
     'title': 'skoda superb diesel estate 2.0 tdi cr 190 laurin + klement '
              '5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr 190 laurin + klement 5dr dsg',
     'vin': None,
     'year': 2016}
2025-12-04 19:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 49672b21-88c2-5c8e-9558-7d02c72e7cab spider: astonbarclay.gb
2025-12-04 19:01:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 49672b21-88c2-5c8e-9558-7d02c72e7cab due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'skoda superb diesel estate 2.0 tdi cr 190 laurin + klement 5dr dsg', 'price': 0, 'currency': 'gbp', 'make': 'skoda', 'model': 'superb diesel estate', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'diesel', 'odometer': 125671, 'odometer_reading_unit': 'mi', 'registration_date': '2016-01-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700684', 'expiration_date': '2025-12-09t10:00:00z', 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '2.0 tdi cr 190 laurin + klement 5dr dsg', 'license_plate': 'vn65hpv', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '49672b21-88c2-5c8e-9558-7d02c72e7cab', 'current_year_diff': 9, 'age_in_months': 118, 'make_model': 'skoda superb diesel estate', 'sanitized_make': 'skoda', 'odometer_in_km': 202247}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 118,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-09t10:00:00z',
     'fuel_type': 'diesel',
     'id': '49672b21-88c2-5c8e-9558-7d02c72e7cab',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'vn65hpv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700684',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'skoda',
     'make_model': 'skoda superb diesel estate',
     'model': 'superb diesel estate',
     'odometer': 125671,
     'odometer_in_km': 202247,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-01-14',
     'sanitized_make': 'skoda',
     'seller_name': 'tcb group - prime',
     'title': 'skoda superb diesel estate 2.0 tdi cr 190 laurin + klement '
              '5dr dsg',
     'transmission': 'automatic',
     'trim': '2.0 tdi cr 190 laurin + klement 5dr dsg',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '49672b21-88c2-5c8e-9558-7d02c72e7cab',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VN65HPV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700684',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'SKODA',
 'model': 'SUPERB DIESEL ESTATE',
 'odometer': 125671,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-14',
 'seller_name': 'TCB Group - Prime',
 'title': 'SKODA SUPERB DIESEL ESTATE 2.0 TDI CR 190 Laurin + Klement 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI CR 190 Laurin + Klement 5dr DSG',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700684%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Saving data for 117700684: {'created_time': 1764874892.944738, 'last_price_update_time': 1764874892.944749, 'auction_closing_time': 1765274400.0}
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117700684') HTTP/1.1" 204 0
2025-12-04 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Found listing with ID: 117175584
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Scrape type for 117175584: 2
2025-12-04 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117272128?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117551950?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:32 [astonbarclay.gb] INFO: Found listing with ID: 117214904
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214904%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117214904: 1
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117681183
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681183%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117681183: 1
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117681145
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681145%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117681145: 1
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117440690
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117440690: 2
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117769670
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117769670%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117769670: 1
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117686757
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686757%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117686757: 1
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5adb810>
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fcea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd492d210>
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b204d0>
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fb25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Found listing with ID: 117681194
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681194%27 HTTP/1.1" 200 None
2025-12-04 19:01:33 [astonbarclay.gb] INFO: Scrape type for 117681194: 1
2025-12-04 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743430?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743298?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743439?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117700553?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743353?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117272128, 'registration': 'DS16FBX', 'account': 'VAN038', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 ecoFLEX SE 5dr', 'mileage': 104028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-06-06', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS16FBX/2025-11-18/image/f27c2516-e01b-4b49-bb19-12063b9b4110_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/13d2b117-54d8-4740-a922-35922bd44d1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/6058d935-c625-4ce6-aa25-f0272fffa0d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/872d880d-8dc8-44d6-ac09-f02d1c0c3a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/8b071db3-ea77-4e5e-8538-bbaf7511c3f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/40f685d0-b9e5-414e-aed0-33966530282c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/97b55ec9-e5cc-4a5f-847c-a2ab0e7a38b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/2820ed40-460d-47af-a6bc-029b238ee6e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/6329ef6e-9812-4298-827d-399af89d6060_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/17 - 9K, 10/17 - 19K, 08/18 - 29K, 06/19 - 39K, 03/20 - 50K, 04/21 - 55K, 05/22 - NO MILEAGE, 05/23 - 82K, 05/24 - 93K', 'remarks': '**1219**VOSA STATES 39K, 51K, 57K, 68K, 82K, 93K, 100K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5494d10-232f-411a-9fbb-c64e4f9b331a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117272128, 'registration': 'DS16FBX', 'account': 'VAN038', 'make': 'VAUXHALL', 'model': 'CORSA HATCHBACK', 'derivative': '1.4 ecoFLEX SE 5dr', 'mileage': 104028, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-06-06', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1398, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS16FBX/2025-11-18/image/f27c2516-e01b-4b49-bb19-12063b9b4110_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/13d2b117-54d8-4740-a922-35922bd44d1b_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/6058d935-c625-4ce6-aa25-f0272fffa0d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/872d880d-8dc8-44d6-ac09-f02d1c0c3a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/8b071db3-ea77-4e5e-8538-bbaf7511c3f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/40f685d0-b9e5-414e-aed0-33966530282c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/97b55ec9-e5cc-4a5f-847c-a2ab0e7a38b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/2820ed40-460d-47af-a6bc-029b238ee6e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS16FBX/2025-11-18/image/6329ef6e-9812-4298-827d-399af89d6060_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 02/17 - 9K, 10/17 - 19K, 08/18 - 29K, 06/19 - 39K, 03/20 - 50K, 04/21 - 55K, 05/22 - NO MILEAGE, 05/23 - 82K, 05/24 - 93K', 'remarks': '**1219**VOSA STATES 39K, 51K, 57K, 68K, 82K, 93K, 100K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 118, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5494d10-232f-411a-9fbb-c64e4f9b331a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d6c6128-55ba-5157-869b-170810000370 with identifier: 117272128
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d6c6128-55ba-5157-869b-170810000370 with scrape type 2
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d6c6128-55ba-5157-869b-170810000370 with scrape type 2
2025-12-04 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d6c6128-55ba-5157-869b-170810000370, identifier: 117272128
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117551950, 'registration': 'MW72BVZ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW GS Line 50kWh 5dr Auto', 'mileage': 15735, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24- 10k, 03/25- 22k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa29dea9-962f-43e0-8ba7-9a6f77b82985.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117551950, 'registration': 'MW72BVZ', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA ELECTRIC HATCHBACK', 'derivative': '100kW GS Line 50kWh 5dr Auto', 'mileage': 15735, 'mileageWarranty': True, 'type': 'car', 'saleId': 17792, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-31', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/138b2e8d-9d08-4817-bbde-baa5eedc2374_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/7bb39238-fee3-482b-871b-994b4a40c5f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/3d1d55cd-c2bb-4afe-b29e-4cec37a7c829_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/2f8ad23f-6c9a-45e2-a428-e1943f5e8782_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/39d7da5d-1e64-40a0-ad55-48f42b5f940f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/de6b317e-4617-4b6d-89f1-6f9ab247e64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/c5597209-0e0a-42dc-bbbb-adb3334fe158_removebg.jpg?w=600', 'https://abimg003.imgix.net/MW72BVZ/2025-11-27/image/5432cc67-d672-4ab7-a5ca-fa554da42a9e_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 02/24- 10k, 03/25- 22k', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa29dea9-962f-43e0-8ba7-9a6f77b82985.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0095f406-b111-5807-86e4-82427de9e080 with scrape type 2
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0095f406-b111-5807-86e4-82427de9e080 with scrape type 2
2025-12-04 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0095f406-b111-5807-86e4-82427de9e080, identifier: 117551950
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117773405
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117773405%27 HTTP/1.1" 200 None
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117773405: 1
2025-12-04 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d6c6128-55ba-5157-869b-170810000370 with identifier: 117272128
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d6c6128-55ba-5157-869b-170810000370 with identifier: 117272128
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 167416 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167416
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 8d6c6128-55ba-5157-869b-170810000370 spider: astonbarclay.gb
2025-12-04 19:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8d6c6128-55ba-5157-869b-170810000370 due to rule: high_mileage_for_country.json, error: 167416 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    167416
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8d6c6128-55ba-5157-869b-170810000370',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS16FBX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117272128',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VAUXHALL',
 'model': 'CORSA HATCHBACK',
 'odometer': 104028,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-06',
 'seller_name': 'Vantage Motor Group',
 'title': 'VAUXHALL CORSA HATCHBACK 1.4 ecoFLEX SE 5dr',
 'transmission': 'manual',
 'trim': '1.4 ecoFLEX SE 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272128%27 HTTP/1.1" 200 None
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Saving data for 117272128: {'auction_closing_time': 1764936000.0, 'created_time': 1763406151.623341, 'last_price_update_time': 1764874894.421721}
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117272128') HTTP/1.1" 204 0
2025-12-04 19:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0095f406-b111-5807-86e4-82427de9e080 with identifier: 117551950
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15735, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw gs line 50kwh 5dr auto', 'license_plate': 'mw72bvz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0095f406-b111-5807-86e4-82427de9e080', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 25322} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'electric',
     'id': '0095f406-b111-5807-86e4-82427de9e080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'mw72bvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 15735,
     'odometer_in_km': 25322,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'motability operations',
     'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw gs line 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 0095f406-b111-5807-86e4-82427de9e080 spider: astonbarclay.gb
2025-12-04 19:01:34 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0095f406-b111-5807-86e4-82427de9e080 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'vauxhall', 'model': 'mokka electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 15735, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '100kw gs line 50kwh 5dr auto', 'license_plate': 'mw72bvz', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '0095f406-b111-5807-86e4-82427de9e080', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'vauxhall mokka electric hatchback', 'sanitized_make': 'vauxhall', 'odometer_in_km': 25322} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'electric',
     'id': '0095f406-b111-5807-86e4-82427de9e080',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'mw72bvz',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'vauxhall',
     'make_model': 'vauxhall mokka electric hatchback',
     'model': 'mokka electric hatchback',
     'odometer': 15735,
     'odometer_in_km': 25322,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-31',
     'sanitized_make': 'vauxhall',
     'seller_name': 'motability operations',
     'title': 'vauxhall mokka electric hatchback 100kw gs line 50kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw gs line 50kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Electric',
 'id': '0095f406-b111-5807-86e4-82427de9e080',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MW72BVZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117551950',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'VAUXHALL',
 'model': 'MOKKA ELECTRIC HATCHBACK',
 'odometer': 15735,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-31',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA ELECTRIC HATCHBACK 100kW GS Line 50kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW GS Line 50kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551950%27 HTTP/1.1" 200 None
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Saving data for 117551950: {'auction_closing_time': 1764936000.0, 'created_time': 1764270164.014593, 'last_price_update_time': 1764874894.6389}
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117551950') HTTP/1.1" 204 0
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Found listing with ID: 117681173
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681173%27 HTTP/1.1" 200 None
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Scrape type for 117681173: 1
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743430, 'registration': 'OW17AWJ', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr', 'mileage': 82478, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 36K, 45K, 54K, 60K, 67K, 78K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743430, 'registration': 'OW17AWJ', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr', 'mileage': 82478, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 36K, 45K, 54K, 60K, 67K, 78K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6ec62c0-5531-5821-bdfe-3e22cb0894f1 with identifier: 117743430
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6ec62c0-5531-5821-bdfe-3e22cb0894f1 with scrape type 1
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a6ec62c0-5531-5821-bdfe-3e22cb0894f1
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a6ec62c0-5531-5821-bdfe-3e22cb0894f1
2025-12-04 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a6ec62c0-5531-5821-bdfe-3e22cb0894f1, identifier: 117743430
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743298, 'registration': 'LD68OJO', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '4.4 SDV8 Vogue SE 4dr Auto', 'mileage': 67349, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': 4367, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/19 - 13K, 11/20 - 21K, 12/21 - 30K, 12/22 - 40K, 10/23 - 48K, 09/24 - 56K, 09/25 - 65K', 'remarks': '**61**VOSA STATES 28K, 38K, 48K, 56K, 65K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 243, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743298, 'registration': 'LD68OJO', 'account': 'HAT006', 'make': 'LAND ROVER', 'model': 'RANGE ROVER DIESEL ESTATE', 'derivative': '4.4 SDV8 Vogue SE 4dr Auto', 'mileage': 67349, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-09', 'doors': 4, 'engineSize': 4367, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/19 - 13K, 11/20 - 21K, 12/21 - 30K, 12/22 - 40K, 10/23 - 48K, 09/24 - 56K, 09/25 - 65K', 'remarks': '**61**VOSA STATES 28K, 38K, 48K, 56K, 65K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 243, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4daae227-9a2c-5bd4-92c3-3f6ac34f4685 with identifier: 117743298
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4daae227-9a2c-5bd4-92c3-3f6ac34f4685 with scrape type 1
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 4daae227-9a2c-5bd4-92c3-3f6ac34f4685
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 4daae227-9a2c-5bd4-92c3-3f6ac34f4685
2025-12-04 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4daae227-9a2c-5bd4-92c3-3f6ac34f4685, identifier: 117743298
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743439, 'registration': 'SM67CLZ', 'account': 'HAT008', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto', 'mileage': 60070, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-27', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 21K, 26K, 34K, 46K, 53K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 183, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743439, 'registration': 'SM67CLZ', 'account': 'HAT008', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto', 'mileage': 60070, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-27', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 21K, 26K, 34K, 46K, 53K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 183, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74c398f1-a4cf-54fe-9bb1-874650a2e25c with identifier: 117743439
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74c398f1-a4cf-54fe-9bb1-874650a2e25c with scrape type 1
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 74c398f1-a4cf-54fe-9bb1-874650a2e25c
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 74c398f1-a4cf-54fe-9bb1-874650a2e25c
2025-12-04 19:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74c398f1-a4cf-54fe-9bb1-874650a2e25c, identifier: 117743439
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117700553, 'registration': 'SH71LTN', 'account': 'THE109', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue ST-Line X Edition 5dr', 'mileage': 74721, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-12-13', 'fuel': 'Diesel', 'motExpiry': '2025-12-12', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 58K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117700553, 'registration': 'SH71LTN', 'account': 'THE109', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '1.5 EcoBlue ST-Line X Edition 5dr', 'mileage': 74721, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2021-12-13', 'fuel': 'Diesel', 'motExpiry': '2025-12-12', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 58K', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33d2600a-70dd-5f57-abaa-e06f9b8b4197 with identifier: 117700553
2025-12-04 19:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33d2600a-70dd-5f57-abaa-e06f9b8b4197 with scrape type 1
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 33d2600a-70dd-5f57-abaa-e06f9b8b4197
2025-12-04 19:01:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 33d2600a-70dd-5f57-abaa-e06f9b8b4197
2025-12-04 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33d2600a-70dd-5f57-abaa-e06f9b8b4197, identifier: 117700553
2025-12-04 19:01:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743353, 'registration': 'YU19FZZ', 'account': 'HAT006', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto', 'mileage': 98027, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-06-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**48**VOSA STATES 36K, 56K, 69K, 87K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743353, 'registration': 'YU19FZZ', 'account': 'HAT006', 'make': 'BMW', 'model': 'X5 DIESEL ESTATE', 'derivative': 'xDrive30d M Sport 5dr Auto', 'mileage': 98027, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-06-28', 'fuel': 'Diesel', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**48**VOSA STATES 36K, 56K, 69K, 87K', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 162, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 with identifier: 117743353
2025-12-04 19:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 with scrape type 1
2025-12-04 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7f2bc476-e576-5a62-ac7d-8d1653fc4a73
2025-12-04 19:01:35 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7f2bc476-e576-5a62-ac7d-8d1653fc4a73
2025-12-04 19:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73, identifier: 117743353
2025-12-04 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a6ec62c0-5531-5821-bdfe-3e22cb0894f1 with identifier: 117743430
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a6ec62c0-5531-5821-bdfe-3e22cb0894f1 with identifier: 117743430
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132735 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132735
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: a6ec62c0-5531-5821-bdfe-3e22cb0894f1 spider: astonbarclay.gb
2025-12-04 19:01:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a6ec62c0-5531-5821-bdfe-3e22cb0894f1 due to rule: high_mileage_for_make.json, error: 132735 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132735
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a6ec62c0-5531-5821-bdfe-3e22cb0894f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OW17AWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743430',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 82478,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 SE Tech 5dr',
 'transmission': 'manual',
 'trim': '2.0 TD4 180 SE Tech 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743430%27 HTTP/1.1" 200 None
2025-12-04 19:01:35 [astonbarclay.gb] INFO: Saving data for 117743430: {'created_time': 1764874895.324543, 'last_price_update_time': 1764874895.324552, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743430') HTTP/1.1" 204 0
2025-12-04 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4daae227-9a2c-5bd4-92c3-3f6ac34f4685 with identifier: 117743298
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4daae227-9a2c-5bd4-92c3-3f6ac34f4685 with identifier: 117743298
2025-12-04 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4daae227-9a2c-5bd4-92c3-3f6ac34f4685 with identifier: 117743298 to the API
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274daae227-9a2c-5bd4-92c3-3f6ac34f4685%27 HTTP/1.1" 200 None
2025-12-04 19:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4daae227-9a2c-5bd4-92c3-3f6ac34f4685: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117743298?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 243,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '4.4L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4daae227-9a2c-5bd4-92c3-3f6ac34f4685',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD68OJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743298',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER DIESEL ESTATE',
 'odometer': 67349,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-17',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER RANGE ROVER DIESEL ESTATE 4.4 SDV8 Vogue SE 4dr Auto',
 'transmission': 'automatic',
 'trim': '4.4 SDV8 Vogue SE 4dr Auto',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743298%27 HTTP/1.1" 200 None
2025-12-04 19:01:35 [astonbarclay.gb] INFO: Saving data for 117743298: {'created_time': 1764874895.614985, 'last_price_update_time': 1764874895.614995, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743298') HTTP/1.1" 204 0
2025-12-04 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74c398f1-a4cf-54fe-9bb1-874650a2e25c with identifier: 117743439
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74c398f1-a4cf-54fe-9bb1-874650a2e25c with identifier: 117743439
2025-12-04 19:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 74c398f1-a4cf-54fe-9bb1-874650a2e25c with identifier: 117743439 to the API
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2774c398f1-a4cf-54fe-9bb1-874650a2e25c%27 HTTP/1.1" 200 None
2025-12-04 19:01:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 74c398f1-a4cf-54fe-9bb1-874650a2e25c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117743439?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 183,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '74c398f1-a4cf-54fe-9bb1-874650a2e25c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SM67CLZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743439',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': 'X5 DIESEL ESTATE',
 'odometer': 60070,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-27',
 'seller_name': 'Hatfields Group',
 'title': 'BMW X5 DIESEL ESTATE xDrive30d M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive30d M Sport 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743439%27 HTTP/1.1" 200 None
2025-12-04 19:01:35 [astonbarclay.gb] INFO: Saving data for 117743439: {'created_time': 1764874895.908384, 'last_price_update_time': 1764874895.908395, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743439') HTTP/1.1" 204 0
2025-12-04 19:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33d2600a-70dd-5f57-abaa-e06f9b8b4197 with identifier: 117700553
2025-12-04 19:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33d2600a-70dd-5f57-abaa-e06f9b8b4197 with identifier: 117700553
2025-12-04 19:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 33d2600a-70dd-5f57-abaa-e06f9b8b4197 with identifier: 117700553 to the API
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2733d2600a-70dd-5f57-abaa-e06f9b8b4197%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 33d2600a-70dd-5f57-abaa-e06f9b8b4197: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117700553?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '33d2600a-70dd-5f57-abaa-e06f9b8b4197',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SH71LTN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117700553',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 74721,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-13',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD KUGA DIESEL ESTATE 1.5 EcoBlue ST-Line X Edition 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue ST-Line X Edition 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117700553%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Saving data for 117700553: {'created_time': 1764874896.230068, 'last_price_update_time': 1764874896.230078, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117700553') HTTP/1.1" 204 0
2025-12-04 19:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 with identifier: 117743353
2025-12-04 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 with identifier: 117743353
2025-12-04 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157758 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157758
2025-12-04 19:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 spider: astonbarclay.gb
2025-12-04 19:01:36 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 7f2bc476-e576-5a62-ac7d-8d1653fc4a73 due to rule: high_mileage_for_country.json, error: 157758 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157758
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7f2bc476-e576-5a62-ac7d-8d1653fc4a73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YU19FZZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743353',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': 'X5 DIESEL ESTATE',
 'odometer': 98027,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seller_name': 'Hatfields Group',
 'title': 'BMW X5 DIESEL ESTATE xDrive30d M Sport 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive30d M Sport 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743353%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Saving data for 117743353: {'created_time': 1764874896.587663, 'last_price_update_time': 1764874896.587672, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743353') HTTP/1.1" 204 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117681229
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681229%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117681229: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117677953
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117677953%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117677953: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117633088
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117633088: 2
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117635092
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117635092: 2
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117289360
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117289360: 2
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117576544
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117576544: 2
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117660676
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660676%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117660676: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117660374
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660374%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117660374: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117576471
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576471%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117576471: 2
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117676438
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676438%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117676438: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117676620
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676620%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117676620: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117651744
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651744%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117651744: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117081997
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117081997%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117081997: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117711420
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117711420%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117711420: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117743814
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743814%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117743814: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117626788
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117626788%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117626788: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117735005
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735005%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117735005: 1
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117681445
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681445%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117681445: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117732515
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732515%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117732515: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117721629
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117721629%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117721629: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117733516
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117733516%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117733516: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117672857
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117672857%27 HTTP/1.1" 200 None
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Scrape type for 117672857: 0
2025-12-04 19:01:36 [astonbarclay.gb] INFO: Found listing with ID: 117721256
2025-12-04 19:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117721256%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117721256: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117702574
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702574%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117702574: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117686371
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686371%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117686371: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117551002
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117551002%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117551002: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117704163
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704163%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117704163: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117704081
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704081%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117704081: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117686613
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686613%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117686613: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117720636
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117720636%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117720636: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117708761
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708761%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117708761: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117710027
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117710027%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117710027: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 116857256
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 116857256: 2
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117709907
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117709907%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117709907: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117709664
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117709664%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117709664: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117667252
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117667252%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117667252: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117741144
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741144%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117741144: 1
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117483520
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117483520: 2
2025-12-04 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743417?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117623603
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623603%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117623603: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117632019
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632019%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117632019: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117706537
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117706537%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117706537: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117679098
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117679098%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117679098: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117660985
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660985%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117660985: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117707924
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707924%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117707924: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117613308
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117613308%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117613308: 0
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 116409684
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 116409684: 2
2025-12-04 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117695719
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695719%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117695719: 2
2025-12-04 19:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117634437?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743417, 'registration': 'YY21UUX', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DEFENDER DIESEL ESTATE', 'derivative': '3.0 D300 X-Dynamic HSE 110 5dr Auto', 'mileage': 82458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 2997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 75K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 235, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743417, 'registration': 'YY21UUX', 'account': 'HAT008', 'make': 'LAND ROVER', 'model': 'DEFENDER DIESEL ESTATE', 'derivative': '3.0 D300 X-Dynamic HSE 110 5dr Auto', 'mileage': 82458, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Diesel', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 2997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA STATES 59K, 75K,', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 235, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f with identifier: 117743417
2025-12-04 19:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b065bb57-a4f4-5ee4-8f02-d1082ea9a35f with scrape type 1
2025-12-04 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b065bb57-a4f4-5ee4-8f02-d1082ea9a35f
2025-12-04 19:01:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b065bb57-a4f4-5ee4-8f02-d1082ea9a35f
2025-12-04 19:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f, identifier: 117743417
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Found listing with ID: 117215946
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Scrape type for 117215946: 2
2025-12-04 19:01:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f with identifier: 117743417
2025-12-04 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f with identifier: 117743417
2025-12-04 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132702 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132702
2025-12-04 19:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f spider: astonbarclay.gb
2025-12-04 19:01:37 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b065bb57-a4f4-5ee4-8f02-d1082ea9a35f due to rule: high_mileage_for_make.json, error: 132702 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132702
{'auction_title': '',
 'c_o_2_emission_value': 235,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'b065bb57-a4f4-5ee4-8f02-d1082ea9a35f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY21UUX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743417',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'LAND ROVER',
 'model': 'DEFENDER DIESEL ESTATE',
 'odometer': 82458,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'Hatfields Group',
 'title': 'LAND ROVER DEFENDER DIESEL ESTATE 3.0 D300 X-Dynamic HSE 110 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '3.0 D300 X-Dynamic HSE 110 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743417%27 HTTP/1.1" 200 None
2025-12-04 19:01:37 [astonbarclay.gb] INFO: Saving data for 117743417: {'created_time': 1764874897.909081, 'last_price_update_time': 1764874897.90909, 'auction_closing_time': 1765285200.0}
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743417') HTTP/1.1" 204 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117660491
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660491%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117660491: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117722193
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117722193%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117722193: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117695935
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695935%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117695935: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117719548
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117719548%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117719548: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117623718
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117623718%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117623718: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117624796
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624796%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117624796: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117702052
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702052%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117702052: 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 116674717
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 116674717: 2
2025-12-04 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576600?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116989244?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116671419?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116755943?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117634437, 'registration': 'PK16LSX', 'account': 'MER023', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 93933, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book S/P @ 08/17 19K INV @ 01/24 77K', 'remarks': "S/KEY - Black Fine Nappa leather S line Sports seats, Running boards, Towbar, manually folding, Electrically adjustable heated front seats, 20 x 8.5J '5-Segment' design alloy wheels in Titanium Optic finish, Adaptive lights, Black styling package,  Door mirrors, electrically adjustable, heated and folding, 3-spoke leather Sports multi-function flat bottomed steering wheel with gear change paddles.", 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc854a14-8b7f-48ac-807d-c7254c7b9941.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117634437, 'registration': 'PK16LSX', 'account': 'MER023', 'make': 'AUDI', 'model': 'Q5 ESTATE SPECIAL EDITIONS', 'derivative': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic', 'mileage': 93933, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-01-25', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/PL16LSX/2025-12-02/image/719324e0-de27-4e14-b714-3a5c06a2a220_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/6043935d-f9a9-4bfb-875e-628744aed9d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/51ccb9ae-76ed-47a4-b517-548572c1a0ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/f487d300-e5d2-4d72-a9a8-f98804a27af7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/b2d0bb6d-4638-4aab-af45-acd6b2d165c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/0df47926-12ea-4ce2-b22c-043f4443abc8_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/c56ccd0a-e4a5-4f1c-8a46-4788fd327b13_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/2c878d17-3181-4357-8e18-f455692c5031_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL16LSX/2025-12-02/image/d765ab40-95ef-4f6f-b5d8-d83ffe00cd17_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book S/P @ 08/17 19K INV @ 01/24 77K', 'remarks': "S/KEY - Black Fine Nappa leather S line Sports seats, Running boards, Towbar, manually folding, Electrically adjustable heated front seats, 20 x 8.5J '5-Segment' design alloy wheels in Titanium Optic finish, Adaptive lights, Black styling package,  Door mirrors, electrically adjustable, heated and folding, 3-spoke leather Sports multi-function flat bottomed steering wheel with gear change paddles.", 'virtual': False, 'seller': 'Mercedes-Benz South West', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 157, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cc854a14-8b7f-48ac-807d-c7254c7b9941.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-04 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f128729-4f66-5610-a7f4-9ce4667c373f with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f128729-4f66-5610-a7f4-9ce4667c373f with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f128729-4f66-5610-a7f4-9ce4667c373f, identifier: 117634437
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117590193
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117590193: 2
2025-12-04 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-04 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f128729-4f66-5610-a7f4-9ce4667c373f with identifier: 117634437
2025-12-04 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 151170 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151170
2025-12-04 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4f128729-4f66-5610-a7f4-9ce4667c373f spider: astonbarclay.gb
2025-12-04 19:01:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4f128729-4f66-5610-a7f4-9ce4667c373f due to rule: high_mileage_for_country.json, error: 151170 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    151170
{'auction_title': '',
 'c_o_2_emission_value': 157,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '4f128729-4f66-5610-a7f4-9ce4667c373f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PK16LSX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117634437',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'Q5 ESTATE SPECIAL EDITIONS',
 'odometer': 93933,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Mercedes-Benz South West',
 'title': 'AUDI Q5 ESTATE SPECIAL EDITIONS 2.0 TDI [190] Quattro S Line Plus '
          '5dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0 TDI [190] Quattro S Line Plus 5dr S Tronic',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117634437%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Saving data for 117634437: {'auction_closing_time': 1765187100.0, 'created_time': 1764702067.564684, 'last_price_update_time': 1764874898.526085}
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117634437') HTTP/1.1" 204 0
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Found listing with ID: 117766955
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117766955%27 HTTP/1.1" 200 None
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Scrape type for 117766955: 1
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117576600, 'registration': 'AF16FJJ', 'account': 'CHE048', 'make': 'AUDI', 'model': 'A5 COUPE', 'derivative': '1.8T FSI 177 S Line 2dr [Nav]', 'mileage': 71699, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-02', 'doors': 2, 'engineSize': 1798, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/15dd9240-3898-4efd-a3c9-bd81ee64cd53_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/5f81ef00-47dc-4283-9202-0587f4350409_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/43dc29a6-66cd-4659-a67d-fbe5878824d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/b92493ce-41dc-4162-a8bd-eedcd343cb87_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/f8824cca-9def-4662-8aee-f35a9ede1c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/abb4b8cf-7a35-465a-be38-c3e1af963b5f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18 19K 03/19 26K 03/21 38K', 'remarks': 'SKEY - POSSIBLE CLUTCH FAULT', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1edb9500-a602-42ee-b68e-1d21647e293d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117576600, 'registration': 'AF16FJJ', 'account': 'CHE048', 'make': 'AUDI', 'model': 'A5 COUPE', 'derivative': '1.8T FSI 177 S Line 2dr [Nav]', 'mileage': 71699, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-04-02', 'doors': 2, 'engineSize': 1798, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/15dd9240-3898-4efd-a3c9-bd81ee64cd53_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/5f81ef00-47dc-4283-9202-0587f4350409_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/43dc29a6-66cd-4659-a67d-fbe5878824d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/b92493ce-41dc-4162-a8bd-eedcd343cb87_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/f8824cca-9def-4662-8aee-f35a9ede1c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF16FJJ/2025-12-01/image/abb4b8cf-7a35-465a-be38-c3e1af963b5f_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/18 19K 03/19 26K 03/21 38K', 'remarks': 'SKEY - POSSIBLE CLUTCH FAULT', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1edb9500-a602-42ee-b68e-1d21647e293d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-04 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf, identifier: 117576600
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116989244, 'registration': 'SL71BVR', 'account': 'KAA001', 'make': 'KIA', 'model': 'CEED DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi 48V ISG 2 NAV 5dr', 'mileage': 71388, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL71BVR/2025-11-06/image/0c9c76cc-cacf-41ec-8fc6-d4635cc9e9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e53f7889-58e4-4f65-9389-679f1205907e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/c8a11b46-c87e-4ec3-9698-a43867d7f1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/9a717801-7853-4876-baa9-13ba2d697b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e3c66449-e2c9-48a4-b1ec-0ab975b039d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/dd28e829-c15e-4cb5-a3d9-ec8f2457f97e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/22 10K 06/22 20K 01/23 31K 03/23 40K 08/23 48K 06/24 62K 10/24 67K', 'remarks': 'Ex-Private Hire / SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f6cc9b1a-9853-42ca-86eb-ff4c00dba1bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116989244, 'registration': 'SL71BVR', 'account': 'KAA001', 'make': 'KIA', 'model': 'CEED DIESEL SPORTSWAGON', 'derivative': '1.6 CRDi 48V ISG 2 NAV 5dr', 'mileage': 71388, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-01-07', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SL71BVR/2025-11-06/image/0c9c76cc-cacf-41ec-8fc6-d4635cc9e9a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e53f7889-58e4-4f65-9389-679f1205907e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/c8a11b46-c87e-4ec3-9698-a43867d7f1e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/9a717801-7853-4876-baa9-13ba2d697b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/e3c66449-e2c9-48a4-b1ec-0ab975b039d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SL71BVR/2025-11-06/image/dd28e829-c15e-4cb5-a3d9-ec8f2457f97e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 02/22 10K 06/22 20K 01/23 31K 03/23 40K 08/23 48K 06/24 62K 10/24 67K', 'remarks': 'Ex-Private Hire / SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f6cc9b1a-9853-42ca-86eb-ff4c00dba1bb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-12-04 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2eedd20e-c246-5175-84a3-54b0e5bc9635 with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2eedd20e-c246-5175-84a3-54b0e5bc9635 with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2eedd20e-c246-5175-84a3-54b0e5bc9635, identifier: 116989244
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116671419, 'registration': 'YP68FOJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T N-Connecta 5dr [7 Seat]', 'mileage': 83805, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/153da7f6-451b-4b03-822c-b360dbd9b03b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8950cb37-a787-4352-9b91-2ec5f8239e6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/904e9e85-e271-4265-81de-532b1b6b440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/bf6d2300-f723-4523-a40e-70b1f16d019a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/73aa14aa-2adf-4e99-b622-a01b3f78ad70_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/7c6c5ac7-0e78-476a-9a1e-8871ed3fc2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/993f8248-d8ad-4196-8e73-e5a4d070a5a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/22c4baea-77d1-495a-b10f-2cb3f7f8cda1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8ca6054f-ba2d-457c-96de-4084cf37fb14_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/5fcd7af8-b5b7-4823-b5ad-abd6ff5d3631_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/a49b2131-ff5c-41c0-90bd-e0a00085baeb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/19 17K 01/21 18K / INV 01/22 37K 10/22 44K 05/25 79K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/743f4e48-3abd-4d79-9e66-f58b5b493675.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116671419, 'registration': 'YP68FOJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL STATION WAGON', 'derivative': '1.6 DiG-T N-Connecta 5dr [7 Seat]', 'mileage': 83805, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-10-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-25', 'doors': 5, 'engineSize': 1618, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/153da7f6-451b-4b03-822c-b360dbd9b03b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8950cb37-a787-4352-9b91-2ec5f8239e6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/904e9e85-e271-4265-81de-532b1b6b440f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/bf6d2300-f723-4523-a40e-70b1f16d019a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/73aa14aa-2adf-4e99-b622-a01b3f78ad70_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/7c6c5ac7-0e78-476a-9a1e-8871ed3fc2a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/993f8248-d8ad-4196-8e73-e5a4d070a5a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/22c4baea-77d1-495a-b10f-2cb3f7f8cda1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/8ca6054f-ba2d-457c-96de-4084cf37fb14_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/5fcd7af8-b5b7-4823-b5ad-abd6ff5d3631_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP68FOJ/2025-10-30/image/a49b2131-ff5c-41c0-90bd-e0a00085baeb_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/19 17K 01/21 18K / INV 01/22 37K 10/22 44K 05/25 79K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/743f4e48-3abd-4d79-9e66-f58b5b493675.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-12-04 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bc2fab3-cfaf-5074-af7f-c002ab916246 with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bc2fab3-cfaf-5074-af7f-c002ab916246 with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9bc2fab3-cfaf-5074-af7f-c002ab916246, identifier: 116671419
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116755943, 'registration': 'EY16OXT', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'INSIGNIA HATCHBACK', 'derivative': '1.8i VVT SRi Nav 5dr', 'mileage': 114713, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 5, 'engineSize': 1796, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY16OXT/2025-10-30/image/d398e150-9e40-4901-9020-b5d3618a1b5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/b711fd5e-327e-403b-9064-25917de32097_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/47e2bc9b-8687-498c-9703-0d6ca3938d01_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/e024c509-6032-49f8-9582-080cac74d256_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/54f68386-c956-47b6-83fa-39fea7b8b7e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/09b91008-6472-40f0-b205-732887e8b559_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/2eeb585c-04cd-439e-9343-accf50569aa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/7b9e5451-fae0-45f4-b780-2cd168a7f20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/64ff96ba-f9e5-4dc2-bfec-18babcf10f5b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'USED UNRECORDED - Damage is stripped and normal wear Ex-Private Hire / NO SPARE KEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 169, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72d0f256-f68c-433c-86a8-0abebb0bcacd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116755943, 'registration': 'EY16OXT', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'INSIGNIA HATCHBACK', 'derivative': '1.8i VVT SRi Nav 5dr', 'mileage': 114713, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 5, 'engineSize': 1796, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY16OXT/2025-10-30/image/d398e150-9e40-4901-9020-b5d3618a1b5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/b711fd5e-327e-403b-9064-25917de32097_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/47e2bc9b-8687-498c-9703-0d6ca3938d01_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/e024c509-6032-49f8-9582-080cac74d256_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/54f68386-c956-47b6-83fa-39fea7b8b7e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/09b91008-6472-40f0-b205-732887e8b559_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/2eeb585c-04cd-439e-9343-accf50569aa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/7b9e5451-fae0-45f4-b780-2cd168a7f20e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY16OXT/2025-10-30/image/64ff96ba-f9e5-4dc2-bfec-18babcf10f5b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'USED UNRECORDED - Damage is stripped and normal wear Ex-Private Hire / NO SPARE KEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 169, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/72d0f256-f68c-433c-86a8-0abebb0bcacd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb55bfcd-d355-55c5-8d95-3c8d9eba408b with identifier: 116755943
2025-12-04 19:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb55bfcd-d355-55c5-8d95-3c8d9eba408b with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb55bfcd-d355-55c5-8d95-3c8d9eba408b with scrape type 2
2025-12-04 19:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb55bfcd-d355-55c5-8d95-3c8d9eba408b, identifier: 116755943
2025-12-04 19:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-04 19:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600
2025-12-04 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6bf3a580-1b4e-5647-a719-b1f2c197c1cf with identifier: 117576600 to the API
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276bf3a580-1b4e-5647-a719-b1f2c197c1cf%27 HTTP/1.1" 200 None
2025-12-04 19:01:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6bf3a580-1b4e-5647-a719-b1f2c197c1cf: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576600?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '6bf3a580-1b4e-5647-a719-b1f2c197c1cf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF16FJJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576600',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'AUDI',
 'model': 'A5 COUPE',
 'odometer': 71699,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'Local Dealer Group',
 'title': 'AUDI A5 COUPE 1.8T FSI 177 S Line 2dr [Nav]',
 'transmission': 'manual',
 'trim': '1.8T FSI 177 S Line 2dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576600%27 HTTP/1.1" 200 None
2025-12-04 19:01:39 [astonbarclay.gb] INFO: Saving data for 117576600: {'auction_closing_time': 1765187100.0, 'created_time': 1764356528.300502, 'last_price_update_time': 1764874899.51856}
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576600') HTTP/1.1" 204 0
2025-12-04 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-12-04 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244
2025-12-04 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2eedd20e-c246-5175-84a3-54b0e5bc9635 with identifier: 116989244 to the API
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%272eedd20e-c246-5175-84a3-54b0e5bc9635%27 HTTP/1.1" 200 None
2025-12-04 19:01:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 2eedd20e-c246-5175-84a3-54b0e5bc9635: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116989244?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '2eedd20e-c246-5175-84a3-54b0e5bc9635',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SL71BVR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116989244',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'KIA',
 'model': 'CEED DIESEL SPORTSWAGON',
 'odometer': 71388,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-12-07',
 'seller_name': 'Local Dealer Group',
 'title': 'KIA CEED DIESEL SPORTSWAGON 1.6 CRDi 48V ISG 2 NAV 5dr',
 'transmission': 'manual',
 'trim': '1.6 CRDi 48V ISG 2 NAV 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116989244%27 HTTP/1.1" 200 None
2025-12-04 19:01:39 [astonbarclay.gb] INFO: Saving data for 116989244: {'auction_closing_time': 1765187100.0, 'created_time': 1762369429.649574, 'last_price_update_time': 1764874899.854838}
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116989244') HTTP/1.1" 204 0
2025-12-04 19:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-12-04 19:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419
2025-12-04 19:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9bc2fab3-cfaf-5074-af7f-c002ab916246 with identifier: 116671419 to the API
2025-12-04 19:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279bc2fab3-cfaf-5074-af7f-c002ab916246%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9bc2fab3-cfaf-5074-af7f-c002ab916246: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116671419?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '9bc2fab3-cfaf-5074-af7f-c002ab916246',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP68FOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116671419',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'X-TRAIL STATION WAGON',
 'odometer': 83805,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-29',
 'seller_name': 'Wilsons',
 'title': 'NISSAN X-TRAIL STATION WAGON 1.6 DiG-T N-Connecta 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.6 DiG-T N-Connecta 5dr [7 Seat]',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116671419%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Saving data for 116671419: {'auction_closing_time': 1765187100.0, 'created_time': 1761764871.311254, 'last_price_update_time': 1764874900.147826}
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116671419') HTTP/1.1" 204 0
2025-12-04 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb55bfcd-d355-55c5-8d95-3c8d9eba408b with identifier: 116755943
2025-12-04 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb55bfcd-d355-55c5-8d95-3c8d9eba408b with identifier: 116755943
2025-12-04 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 184612 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184612
2025-12-04 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: eb55bfcd-d355-55c5-8d95-3c8d9eba408b spider: astonbarclay.gb
2025-12-04 19:01:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: eb55bfcd-d355-55c5-8d95-3c8d9eba408b due to rule: high_mileage_for_country.json, error: 184612 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    184612
{'auction_title': '',
 'c_o_2_emission_value': 169,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'eb55bfcd-d355-55c5-8d95-3c8d9eba408b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY16OXT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116755943',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'INSIGNIA HATCHBACK',
 'odometer': 114713,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-16',
 'seller_name': 'Zuto',
 'title': 'VAUXHALL INSIGNIA HATCHBACK 1.8i VVT SRi Nav 5dr',
 'transmission': 'manual',
 'trim': '1.8i VVT SRi Nav 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116755943%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Saving data for 116755943: {'auction_closing_time': 1765187100.0, 'created_time': 1764097569.884407, 'last_price_update_time': 1764874900.376057}
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116755943') HTTP/1.1" 204 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117635166
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635166%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117635166: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117699895
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699895%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117699895: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117699816
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117699816%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117699816: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117735830
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735830%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117735830: 1
2025-12-04 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114089759?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117739170
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117739170%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117739170: 1
2025-12-04 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117621873
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621873%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117621873: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117736230
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117736230%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117736230: 1
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117704311
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704311%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117704311: 1
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117641049
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641049%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117641049: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117641062
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117641062%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117641062: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117659595
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117659595%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117659595: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117734051
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117734051%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117734051: 1
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 116802225
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 116802225: 2
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 114089759, 'registration': 'DY16GUA', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 75134, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-24', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY16GUA/2025-07-23/image/cedcf7b5-79b1-4ffa-88d6-79ce66dfd870_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/e61a7fbd-9791-4b5d-b237-c6f899d37b5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/eace6cfa-5c07-4e18-90dd-5054769c2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/7dcbf720-e1ca-4176-a6ec-496ed6ac36b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/2f030bef-6ee7-472e-b3d9-8288853643df_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/38436d17-8552-46f5-9735-0ce3c27fdbd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/f6f75cdd-0628-4c1c-9015-e8156c6f6645_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/16fde75f-4421-414d-99dc-288c73adaf7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/77c1e464-72df-4399-a445-7a695d50b2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/85a064aa-edae-4fb3-aaf8-3f96154c5a5b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 03/19 31K 03/21 44K 03/22 53K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4b2264b-39ba-459e-b6f5-0bd513bf0fe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 114089759, 'registration': 'DY16GUA', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 HSE Dynamic 5dr Auto', 'mileage': 75134, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-03-24', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DY16GUA/2025-07-23/image/cedcf7b5-79b1-4ffa-88d6-79ce66dfd870_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/e61a7fbd-9791-4b5d-b237-c6f899d37b5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/eace6cfa-5c07-4e18-90dd-5054769c2255_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/7dcbf720-e1ca-4176-a6ec-496ed6ac36b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/2f030bef-6ee7-472e-b3d9-8288853643df_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/38436d17-8552-46f5-9735-0ce3c27fdbd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/f6f75cdd-0628-4c1c-9015-e8156c6f6645_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/16fde75f-4421-414d-99dc-288c73adaf7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/77c1e464-72df-4399-a445-7a695d50b2e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DY16GUA/2025-07-23/image/85a064aa-edae-4fb3-aaf8-3f96154c5a5b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 03/19 31K 03/21 44K 03/22 53K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f4b2264b-39ba-459e-b6f5-0bd513bf0fe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53b60152-a3d4-5c8f-b75a-763d20faa6aa with identifier: 114089759
2025-12-04 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53b60152-a3d4-5c8f-b75a-763d20faa6aa with scrape type 2
2025-12-04 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53b60152-a3d4-5c8f-b75a-763d20faa6aa with scrape type 2
2025-12-04 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 53b60152-a3d4-5c8f-b75a-763d20faa6aa, identifier: 114089759
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117131550, 'registration': 'BH19XWJ', 'account': 'WIL004', 'make': 'CITROEN', 'model': 'GRAND C4 SPACETOURER ESTATE (RC)', 'derivative': '1.2 PureTech 130 Flair 5dr', 'mileage': 44461, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-08-12', 'fuel': 'Petrol', 'motExpiry': '2026-08-11', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f4eff252-fb17-4b3c-a49b-431948aaae35_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/f693600e-cd70-4b99-a583-152af9014350_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/cc966adf-816c-4cb4-a223-76af9f6756ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/fb5bb530-683d-4cba-adc5-f4bbc3788d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/79430369-61e5-46fc-b127-3f8342c7041c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/5fb27594-c4ef-43c7-9a19-83acc4a28e93_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/98eeb9ce-36b2-456f-9675-a75015b88390_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/413ecfdf-9198-4039-a77f-34a3ad6bd1ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/4b2eee3a-7b32-4756-96f9-ec86fecb9ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/0755e8cb-d879-4ac0-9e87-ae0aee3aede3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BH19XWJ/2025-11-18/image/8d8070a8-d31b-4d14-89c4-bd9add7f6c3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 12/19 4K 12/20 13K 12/21 15K 01/23 22K 04/24 32K 03/25 39K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cbb809c2-c6a3-474e-85e4-43507be38cad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-04 19:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-12-04 19:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e16b1caf-3652-5871-a205-1b3f29f09607 with scrape type 2
2025-12-04 19:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e16b1caf-3652-5871-a205-1b3f29f09607, identifier: 117131550
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117621842
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621842%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117621842: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117621861
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621861%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117621861: 0
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Found listing with ID: 117676562
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676562%27 HTTP/1.1" 200 None
2025-12-04 19:01:40 [astonbarclay.gb] INFO: Scrape type for 117676562: 1
2025-12-04 19:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 53b60152-a3d4-5c8f-b75a-763d20faa6aa with identifier: 114089759
2025-12-04 19:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 53b60152-a3d4-5c8f-b75a-763d20faa6aa with identifier: 114089759
2025-12-04 19:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 53b60152-a3d4-5c8f-b75a-763d20faa6aa with identifier: 114089759 to the API
2025-12-04 19:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114089759?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '53b60152-a3d4-5c8f-b75a-763d20faa6aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DY16GUA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114089759',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 75134,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-24',
 'seller_name': 'Zuto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 HSE Dynamic '
          '5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 HSE Dynamic 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114089759%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Saving data for 114089759: {'auction_closing_time': 1765187100.0, 'created_time': 1764097540.787558, 'last_price_update_time': 1764874901.187386}
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114089759') HTTP/1.1" 204 0
2025-12-04 19:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-04 19:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550
2025-12-04 19:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e16b1caf-3652-5871-a205-1b3f29f09607 with identifier: 117131550 to the API
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e16b1caf-3652-5871-a205-1b3f29f09607%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e16b1caf-3652-5871-a205-1b3f29f09607: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:40 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131550?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'e16b1caf-3652-5871-a205-1b3f29f09607',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BH19XWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131550',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'CITROEN',
 'model': 'GRAND C4 SPACETOURER ESTATE (RC)',
 'odometer': 44461,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-08-12',
 'seller_name': 'Wilsons',
 'title': 'CITROEN GRAND C4 SPACETOURER ESTATE (RC) 1.2 PureTech 130 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 130 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131550%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Saving data for 117131550: {'auction_closing_time': 1765187100.0, 'created_time': 1763060638.767022, 'last_price_update_time': 1764874901.547329}
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131550') HTTP/1.1" 204 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117621852
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117621852%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117621852: 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117245171
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117245171: 2
2025-12-04 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117686757?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117175645?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681194?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117769670?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117727318
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117727318%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117727318: 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 116859641
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 116859641: 2
2025-12-04 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117689641
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117689641%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117689641: 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117713732
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117713732%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117713732: 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117737357
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737357%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117737357: 1
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117703363
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117703363%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117703363: 0
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 117739947
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117739947%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 117739947: 1
2025-12-04 19:01:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Found listing with ID: 116377459
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Scrape type for 116377459: 2
2025-12-04 19:01:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117686757, 'registration': 'AU66ZFL', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I40 DIESEL TOURER', 'derivative': '1.7 CRDi [115] Blue Drive S 5dr', 'mileage': 164935, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ff6af95-5329-4c37-a9e7-b4a7bf306014.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117686757, 'registration': 'AU66ZFL', 'account': 'THE109', 'make': 'HYUNDAI', 'model': 'I40 DIESEL TOURER', 'derivative': '1.7 CRDi [115] Blue Drive S 5dr', 'mileage': 164935, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-31', 'fuel': 'Diesel', 'motExpiry': '2026-02-06', 'doors': 5, 'engineSize': 1685, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0ff6af95-5329-4c37-a9e7-b4a7bf306014.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e2d7ea7-7965-5f63-bef7-99cb594e6942 with identifier: 117686757
2025-12-04 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e2d7ea7-7965-5f63-bef7-99cb594e6942 with scrape type 1
2025-12-04 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 8e2d7ea7-7965-5f63-bef7-99cb594e6942
2025-12-04 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 8e2d7ea7-7965-5f63-bef7-99cb594e6942
2025-12-04 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8e2d7ea7-7965-5f63-bef7-99cb594e6942, identifier: 117686757
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117175645, 'registration': 'LD16ZGG', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 64401, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-25', 'fuel': 'Petrol', 'motExpiry': '2025-10-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2de7a411-c89e-4f37-b214-f53fb39b1c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/9e0af537-a9dd-4ab6-b0a8-35cf2074e543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/4c651648-d64d-46d8-8ce3-c77b30c5846d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/af9119d4-91ef-4a95-a598-0b11d053c7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/1e338ac0-373f-455f-b38d-1627f870515e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/980eb039-974d-4d41-b953-5e50b48b01fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2566840e-0325-4b37-a0dd-2528a705a2c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/814f93be-680e-4888-abe8-d09aadff9555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/98702116-45ea-4f43-965d-9a2f70caa6fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/41dba378-48b3-48ae-b329-4a97fadf1309_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 3K 02/18 12K 02/19 22K 02/20 29K 03/21 33K 06/22 42K 02/25 52K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ed834d5-661e-4318-a6e2-96fee118c244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117175645, 'registration': 'LD16ZGG', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 64401, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-25', 'fuel': 'Petrol', 'motExpiry': '2025-10-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2de7a411-c89e-4f37-b214-f53fb39b1c52_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/9e0af537-a9dd-4ab6-b0a8-35cf2074e543_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/4c651648-d64d-46d8-8ce3-c77b30c5846d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/af9119d4-91ef-4a95-a598-0b11d053c7ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/1e338ac0-373f-455f-b38d-1627f870515e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/980eb039-974d-4d41-b953-5e50b48b01fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/2566840e-0325-4b37-a0dd-2528a705a2c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/814f93be-680e-4888-abe8-d09aadff9555_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/98702116-45ea-4f43-965d-9a2f70caa6fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/LD16ZGG/2025-11-17/image/41dba378-48b3-48ae-b329-4a97fadf1309_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/17 3K 02/18 12K 02/19 22K 02/20 29K 03/21 33K 06/22 42K 02/25 52K', 'remarks': 'SKEY, SD CARD', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6ed834d5-661e-4318-a6e2-96fee118c244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-12-04 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with scrape type 2
2025-12-04 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with scrape type 2
2025-12-04 19:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8, identifier: 117175645
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681194, 'registration': 'OE69AHA', 'account': 'WIL004', 'make': 'SKODA', 'model': 'FABIA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 TSI Colour Edition 5dr', 'mileage': 78092, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-07', 'fuel': 'Petrol', 'motExpiry': '2026-09-17', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681194, 'registration': 'OE69AHA', 'account': 'WIL004', 'make': 'SKODA', 'model': 'FABIA HATCHBACK SPECIAL EDITIONS', 'derivative': '1.0 TSI Colour Edition 5dr', 'mileage': 78092, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-11-07', 'fuel': 'Petrol', 'motExpiry': '2026-09-17', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3837205-ec3f-5212-aa13-cae6def8f80c with identifier: 117681194
2025-12-04 19:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3837205-ec3f-5212-aa13-cae6def8f80c with scrape type 1
2025-12-04 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f3837205-ec3f-5212-aa13-cae6def8f80c
2025-12-04 19:01:41 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f3837205-ec3f-5212-aa13-cae6def8f80c
2025-12-04 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f3837205-ec3f-5212-aa13-cae6def8f80c, identifier: 117681194
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117769670, 'registration': 'PF69AOV', 'account': 'ANC013', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SRi Nav 5dr Auto', 'mileage': 43030, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-12-03', 'fuel': 'Petrol', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Anchor Group Remarketing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4be6cf4d-cd58-4a19-9b2d-f575f009326b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117769670, 'registration': 'PF69AOV', 'account': 'ANC013', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SRi Nav 5dr Auto', 'mileage': 43030, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-12-03', 'fuel': 'Petrol', 'motExpiry': '2025-12-14', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Anchor Group Remarketing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4be6cf4d-cd58-4a19-9b2d-f575f009326b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad with identifier: 117769670
2025-12-04 19:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad with scrape type 1
2025-12-04 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad
2025-12-04 19:01:42 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad
2025-12-04 19:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad, identifier: 117769670
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117705726
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117705726%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117705726: 0
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117021986
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117021986%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117021986: 0
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117662175
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662175%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117662175: 0
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117662184
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662184%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117662184: 0
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117662195
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662195%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117662195: 0
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Found listing with ID: 117768352
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768352%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Scrape type for 117768352: 1
2025-12-04 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8e2d7ea7-7965-5f63-bef7-99cb594e6942 with identifier: 117686757
2025-12-04 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8e2d7ea7-7965-5f63-bef7-99cb594e6942 with identifier: 117686757
2025-12-04 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'hyundai i40 diesel tourer 1.7 crdi [115] blue drive s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'i40 diesel tourer', 'transmission': 'manual', 'engine': '1.7l', 'fuel_type': 'diesel', 'odometer': 164935, 'odometer_reading_unit': 'mi', 'registration_date': '2016-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686757', 'expiration_date': '2025-12-10t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.7 crdi [115] blue drive s 5dr', 'license_plate': 'au66zfl', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 110, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8e2d7ea7-7965-5f63-bef7-99cb594e6942', 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'hyundai i40 diesel tourer', 'sanitized_make': 'hyundai', 'odometer_in_km': 265436}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 109,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.7l',
     'expiration_date': '2025-12-10t09:45:00z',
     'fuel_type': 'diesel',
     'id': '8e2d7ea7-7965-5f63-bef7-99cb594e6942',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'au66zfl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686757',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'hyundai',
     'make_model': 'hyundai i40 diesel tourer',
     'model': 'i40 diesel tourer',
     'odometer': 164935,
     'odometer_in_km': 265436,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-10-31',
     'sanitized_make': 'hyundai',
     'seller_name': 'tcb group - prime',
     'title': 'hyundai i40 diesel tourer 1.7 crdi [115] blue drive s 5dr',
     'transmission': 'manual',
     'trim': '1.7 crdi [115] blue drive s 5dr',
     'vin': None,
     'year': 2016}
2025-12-04 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 8e2d7ea7-7965-5f63-bef7-99cb594e6942 spider: astonbarclay.gb
2025-12-04 19:01:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8e2d7ea7-7965-5f63-bef7-99cb594e6942 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'tcb group - prime', 'price_includes_vat': False, 'title': 'hyundai i40 diesel tourer 1.7 crdi [115] blue drive s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'i40 diesel tourer', 'transmission': 'manual', 'engine': '1.7l', 'fuel_type': 'diesel', 'odometer': 164935, 'odometer_reading_unit': 'mi', 'registration_date': '2016-10-31', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686757', 'expiration_date': '2025-12-10t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.7 crdi [115] blue drive s 5dr', 'license_plate': 'au66zfl', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 110, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8e2d7ea7-7965-5f63-bef7-99cb594e6942', 'current_year_diff': 9, 'age_in_months': 109, 'make_model': 'hyundai i40 diesel tourer', 'sanitized_make': 'hyundai', 'odometer_in_km': 265436}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 109,
     'auction_title': '',
     'c_o_2_emission_value': 110,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.7l',
     'expiration_date': '2025-12-10t09:45:00z',
     'fuel_type': 'diesel',
     'id': '8e2d7ea7-7965-5f63-bef7-99cb594e6942',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'au66zfl',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686757',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'hyundai',
     'make_model': 'hyundai i40 diesel tourer',
     'model': 'i40 diesel tourer',
     'odometer': 164935,
     'odometer_in_km': 265436,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-10-31',
     'sanitized_make': 'hyundai',
     'seller_name': 'tcb group - prime',
     'title': 'hyundai i40 diesel tourer 1.7 crdi [115] blue drive s 5dr',
     'transmission': 'manual',
     'trim': '1.7 crdi [115] blue drive s 5dr',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.7L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '8e2d7ea7-7965-5f63-bef7-99cb594e6942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AU66ZFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117686757',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'I40 DIESEL TOURER',
 'odometer': 164935,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I40 DIESEL TOURER 1.7 CRDi [115] Blue Drive S 5dr',
 'transmission': 'manual',
 'trim': '1.7 CRDi [115] Blue Drive S 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117686757%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Saving data for 117686757: {'created_time': 1764874902.586545, 'last_price_update_time': 1764874902.586555, 'auction_closing_time': 1765359900.0}
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117686757') HTTP/1.1" 204 0
2025-12-04 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-12-04 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645
2025-12-04 19:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8 with identifier: 117175645 to the API
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277dd6abaa-6062-5fec-a9ac-3d67d29f12c8%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7dd6abaa-6062-5fec-a9ac-3d67d29f12c8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117175645?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7dd6abaa-6062-5fec-a9ac-3d67d29f12c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD16ZGG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117175645',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 64401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-25',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175645%27 HTTP/1.1" 200 None
2025-12-04 19:01:42 [astonbarclay.gb] INFO: Saving data for 117175645: {'auction_closing_time': 1765187100.0, 'created_time': 1763146924.333359, 'last_price_update_time': 1764874902.970788}
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117175645') HTTP/1.1" 204 0
2025-12-04 19:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f3837205-ec3f-5212-aa13-cae6def8f80c with identifier: 117681194
2025-12-04 19:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f3837205-ec3f-5212-aa13-cae6def8f80c with identifier: 117681194
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f3837205-ec3f-5212-aa13-cae6def8f80c with identifier: 117681194 to the API
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f3837205-ec3f-5212-aa13-cae6def8f80c%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f3837205-ec3f-5212-aa13-cae6def8f80c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117681194?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'f3837205-ec3f-5212-aa13-cae6def8f80c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE69AHA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681194',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'SKODA',
 'model': 'FABIA HATCHBACK SPECIAL EDITIONS',
 'odometer': 78092,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-07',
 'seller_name': 'Wilsons',
 'title': 'SKODA FABIA HATCHBACK SPECIAL EDITIONS 1.0 TSI Colour Edition 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI Colour Edition 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681194%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Saving data for 117681194: {'created_time': 1764874903.294222, 'last_price_update_time': 1764874903.294232, 'auction_closing_time': 1765359900.0}
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681194') HTTP/1.1" 204 0
2025-12-04 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad with identifier: 117769670
2025-12-04 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad with identifier: 117769670
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad with identifier: 117769670 to the API
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:42 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117769670?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '633b8905-f7d6-55d8-a9a1-6b9bc5c3c1ad',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PF69AOV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117769670',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 43030,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-03',
 'seller_name': 'Anchor Group Remarketing',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo SRi Nav 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo SRi Nav 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117769670%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Saving data for 117769670: {'created_time': 1764874903.586389, 'last_price_update_time': 1764874903.586399, 'auction_closing_time': 1765359900.0}
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117769670') HTTP/1.1" 204 0
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117543749
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117543749: 2
2025-12-04 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681145?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117175584, 'registration': 'YE20USZ', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS DIESEL ESTATE', 'derivative': '1.5 EcoBlue 120 Active X 5dr', 'mileage': 53373, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-06-17', 'fuel': 'Diesel', 'motExpiry': '2026-04-16', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff6a0a32-e9c9-48f9-8710-82bda23066bc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/9bf0b407-f58b-4abf-a04b-8a33e6ceb70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/ff1700f9-12fb-42f6-aca3-54246badf853_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/3b4db2be-395b-4c00-aa88-7b5b16e8dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/f946f23e-9f36-4724-9f67-cf4655ff471c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/21dbc6dd-427b-46c3-873a-d91784820ae6_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/db73a3c7-ed7d-450f-b021-a27fe9c755b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/75be46ea-911b-421b-abf8-bcdd230148a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/6dbd76d3-010b-407e-b8fb-5af132f6661a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YE20USZ/2025-11-18/image/2fc890e8-a8ea-4103-9ad3-5ec93b6d9f39_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 06/23 9K 07/24 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9276b3bc-ebf2-44a9-9fa5-1d7c85672c41.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-04 19:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-12-04 19:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910f4a33-d3b5-573d-a08f-06650114b76d with scrape type 2
2025-12-04 19:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 910f4a33-d3b5-573d-a08f-06650114b76d, identifier: 117175584
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Found listing with ID: 117495072
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [astonbarclay.gb] INFO: Scrape type for 117495072: 2
2025-12-04 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-04 19:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 910f4a33-d3b5-573d-a08f-06650114b76d with identifier: 117175584 to the API
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27910f4a33-d3b5-573d-a08f-06650114b76d%27 HTTP/1.1" 200 None
2025-12-04 19:01:43 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 910f4a33-d3b5-573d-a08f-06650114b76d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117175584?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '910f4a33-d3b5-573d-a08f-06650114b76d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YE20USZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117175584',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS DIESEL ESTATE',
 'odometer': 53373,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-06-17',
 'seller_name': 'Wilsons',
 'title': 'FORD FOCUS DIESEL ESTATE 1.5 EcoBlue 120 Active X 5dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBlue 120 Active X 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117175584%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Saving data for 117175584: {'auction_closing_time': 1765359900.0, 'created_time': 1763146933.810574, 'last_price_update_time': 1764874904.013287}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117175584') HTTP/1.1" 204 0
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117495107
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117495107: 2
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681145, 'registration': 'BJ17OWE', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 73206, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681145, 'registration': 'BJ17OWE', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 73206, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-03-23', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffddcec6-5f34-5c79-988f-6a2fbe4be771 with identifier: 117681145
2025-12-04 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffddcec6-5f34-5c79-988f-6a2fbe4be771 with scrape type 1
2025-12-04 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ffddcec6-5f34-5c79-988f-6a2fbe4be771
2025-12-04 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ffddcec6-5f34-5c79-988f-6a2fbe4be771
2025-12-04 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffddcec6-5f34-5c79-988f-6a2fbe4be771, identifier: 117681145
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117440690, 'registration': 'SO19CYF', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'I800 DIESEL ESTATE', 'derivative': '2.5 CRDi SE Nav 5dr', 'mileage': 85554, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-11-17', 'doors': 5, 'engineSize': 2497, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SO19CYF/2025-11-24/image/5fd3fe85-2d8b-4151-8a70-893864948ada_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/a95a7948-2d4b-45a1-82d0-f4683bfa26f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/afde87ce-3d30-4e4c-aca5-170fcccf9cf7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ca2285f1-376e-4277-829f-24a1a74770dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/005f9c80-ed26-4dd5-9889-bb9b8dc40f2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/7e8262bf-8428-4153-825d-fbeffc9998b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/0480595d-c5e5-4167-ab3f-3537bc1c1a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/ff5e7bce-9c77-49af-9bea-4be21f14b712_removebg.jpg?w=600', 'https://abimg003.imgix.net/SO19CYF/2025-11-24/image/c4ee2993-ce41-48c7-977f-d4ca32e53527_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 2 X SB 08/20 25K 08/21 45K 04/22 60K 10/23 70K', 'remarks': 'S/KEY SD', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 222, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5e6b2d25-d8e4-4dc6-a7c8-229f77d460c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-04 19:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-12-04 19:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0505eef-8935-5965-96f3-60a649d896ef with scrape type 2
2025-12-04 19:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b0505eef-8935-5965-96f3-60a649d896ef, identifier: 117440690
2025-12-04 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffddcec6-5f34-5c79-988f-6a2fbe4be771 with identifier: 117681145
2025-12-04 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffddcec6-5f34-5c79-988f-6a2fbe4be771 with identifier: 117681145
2025-12-04 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ffddcec6-5f34-5c79-988f-6a2fbe4be771 with identifier: 117681145 to the API
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ffddcec6-5f34-5c79-988f-6a2fbe4be771%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ffddcec6-5f34-5c79-988f-6a2fbe4be771: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117681145?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'ffddcec6-5f34-5c79-988f-6a2fbe4be771',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BJ17OWE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681145',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 73206,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-24',
 'seller_name': 'Wilsons',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681145%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Saving data for 117681145: {'created_time': 1764874904.533074, 'last_price_update_time': 1764874904.533084, 'auction_closing_time': 1765359900.0}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681145') HTTP/1.1" 204 0
2025-12-04 19:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-04 19:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690
2025-12-04 19:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b0505eef-8935-5965-96f3-60a649d896ef with identifier: 117440690 to the API
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b0505eef-8935-5965-96f3-60a649d896ef%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b0505eef-8935-5965-96f3-60a649d896ef: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:43 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117440690?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 222,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'b0505eef-8935-5965-96f3-60a649d896ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SO19CYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117440690',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'I800 DIESEL ESTATE',
 'odometer': 85554,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-23',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI I800 DIESEL ESTATE 2.5 CRDi SE Nav 5dr',
 'transmission': 'manual',
 'trim': '2.5 CRDi SE Nav 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117440690%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Saving data for 117440690: {'auction_closing_time': 1765187100.0, 'created_time': 1763974953.893626, 'last_price_update_time': 1764874904.806255}
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117440690') HTTP/1.1" 204 0
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117768376
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768376%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117768376: 1
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 116993535
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116993535%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 116993535: 0
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117639547
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117639547%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117639547: 0
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117770159
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117770159%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117770159: 1
2025-12-04 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117741144?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117495054
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117495054: 2
2025-12-04 19:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117763810
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763810%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117763810: 1
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117708690
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708690%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117708690: 0
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117567350
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117567350: 2
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117763389
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763389%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117763389: 1
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117768497
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768497%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117768497: 1
2025-12-04 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117483520?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117695719?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117495085
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Scrape type for 117495085: 2
2025-12-04 19:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116409684?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:44 [astonbarclay.gb] INFO: Found listing with ID: 117269658
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117269658%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117269658: 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117260567
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117260567%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117260567: 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117411447
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117411447%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117411447: 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117242944
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117242944: 2
2025-12-04 19:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117741144, 'registration': 'EN65BJO', 'account': 'ESS030', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 89352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-01-21', 'fuel': 'Diesel', 'motExpiry': '2026-01-20', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ed9dad9-df16-485d-b453-b1cea62f35b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117741144, 'registration': 'EN65BJO', 'account': 'ESS030', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr Powershift', 'mileage': 89352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-01-21', 'fuel': 'Diesel', 'motExpiry': '2026-01-20', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5ed9dad9-df16-485d-b453-b1cea62f35b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9190c2e7-3f44-57a2-9a3a-24cba98e189d with identifier: 117741144
2025-12-04 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9190c2e7-3f44-57a2-9a3a-24cba98e189d with scrape type 1
2025-12-04 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 9190c2e7-3f44-57a2-9a3a-24cba98e189d
2025-12-04 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 9190c2e7-3f44-57a2-9a3a-24cba98e189d
2025-12-04 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9190c2e7-3f44-57a2-9a3a-24cba98e189d, identifier: 117741144
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117194162
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117194162: 2
2025-12-04 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9190c2e7-3f44-57a2-9a3a-24cba98e189d with identifier: 117741144
2025-12-04 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9190c2e7-3f44-57a2-9a3a-24cba98e189d with identifier: 117741144
2025-12-04 19:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9190c2e7-3f44-57a2-9a3a-24cba98e189d with identifier: 117741144 to the API
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279190c2e7-3f44-57a2-9a3a-24cba98e189d%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9190c2e7-3f44-57a2-9a3a-24cba98e189d: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117741144?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '9190c2e7-3f44-57a2-9a3a-24cba98e189d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN65BJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117741144',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 89352,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': 'SMC GROUP',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 TDCi 180 Titanium 5dr Powershift',
 'transmission': 'automatic',
 'trim': '2.0 TDCi 180 Titanium 5dr Powershift',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741144%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Saving data for 117741144: {'created_time': 1764874905.456189, 'last_price_update_time': 1764874905.456202, 'auction_closing_time': 1765360800.0}
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117741144') HTTP/1.1" 204 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117140308
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117140308: 2
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117483520, 'registration': 'M13NNH', 'account': 'GAT009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 48216, 'mileageWarranty': False, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/M13NNH/2025-11-27/image/4e5581d0-5ac0-4d4a-8752-78de9d609e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/d166bf4c-021e-4b3a-a26f-327d81394e51_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/08f3a409-422f-400c-bd13-e0bbd4266c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/02175cb6-b563-48dc-8b16-46735f2d6470_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/fea4ac3e-1fda-49e1-8b8d-a39ba2fd7888_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/a5db11ed-a51e-47b3-a4be-a0cc78eac64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/cb31fc81-59d4-457e-b2e3-8ca243e5631b_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/01506830-0b67-4c3d-8b32-10242475e6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/9b3f4c18-c920-454b-9ff8-7c24ff0c2d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/7da7c44a-cef5-4176-b980-cd3edaf86f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/4358e981-8077-45e3-864f-0328b88c69c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/e494080e-2329-4e43-9e4d-1f997d5f56e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/d883db42-1fb2-43d2-8a0f-4d3f632e5d0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service digital 11/22 18k- 03/24 27k- 01/25 37k -', 'remarks': 'VOSA STATES 27K - 41K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cc37af2-a570-490b-8109-07360d43c9c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117483520, 'registration': 'M13NNH', 'account': 'GAT009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': 'M135i xDrive 5dr Step Auto', 'mileage': 48216, 'mileageWarranty': False, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-03-30', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/M13NNH/2025-11-27/image/4e5581d0-5ac0-4d4a-8752-78de9d609e87_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/d166bf4c-021e-4b3a-a26f-327d81394e51_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/08f3a409-422f-400c-bd13-e0bbd4266c62_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/02175cb6-b563-48dc-8b16-46735f2d6470_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/fea4ac3e-1fda-49e1-8b8d-a39ba2fd7888_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/a5db11ed-a51e-47b3-a4be-a0cc78eac64f_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/cb31fc81-59d4-457e-b2e3-8ca243e5631b_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/01506830-0b67-4c3d-8b32-10242475e6ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/9b3f4c18-c920-454b-9ff8-7c24ff0c2d1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/7da7c44a-cef5-4176-b980-cd3edaf86f69_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/4358e981-8077-45e3-864f-0328b88c69c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/e494080e-2329-4e43-9e4d-1f997d5f56e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/M13NNH/2025-11-27/image/d883db42-1fb2-43d2-8a0f-4d3f632e5d0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service digital 11/22 18k- 03/24 27k- 01/25 37k -', 'remarks': 'VOSA STATES 27K - 41K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6cc37af2-a570-490b-8109-07360d43c9c2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a61c4883-39d1-5d0b-8307-7c32aef39e94 with identifier: 117483520
2025-12-04 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a61c4883-39d1-5d0b-8307-7c32aef39e94 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a61c4883-39d1-5d0b-8307-7c32aef39e94 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a61c4883-39d1-5d0b-8307-7c32aef39e94, identifier: 117483520
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117695719, 'registration': 'EO72RZA', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Design 5dr CVT', 'mileage': 10943, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO72RZA/2025-12-03/image/daf59340-585e-45f8-920c-83444c87310b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/adc0fce6-6f54-46d2-9682-54a9e7cda1f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/f1bfb3c9-a695-4811-a464-fe7d4797a948_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/f7119f51-1aa5-4b5a-a23e-effc00a954f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/54f706c3-6785-4448-ade1-e033e21ed913_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/433153f4-3884-4b54-adb6-93b99d8179ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/42a5c561-0aab-48b3-a45d-ce667d7caa19_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/916f57cf-bc33-48ac-9c98-07d30ec86e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/709a3194-d48c-4cf3-8482-3bc103a9405f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/23- 3K, 08/24- 5K, 08/25- 9K', 'remarks': 'VOSA STATES 9K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31dcca53-3880-4be8-a56f-4f183bd364da.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117695719, 'registration': 'EO72RZA', 'account': 'WBA002', 'make': 'TOYOTA', 'model': 'YARIS HATCHBACK', 'derivative': '1.5 Hybrid Design 5dr CVT', 'mileage': 10943, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-01', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1490, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EO72RZA/2025-12-03/image/daf59340-585e-45f8-920c-83444c87310b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/adc0fce6-6f54-46d2-9682-54a9e7cda1f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/f1bfb3c9-a695-4811-a464-fe7d4797a948_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/f7119f51-1aa5-4b5a-a23e-effc00a954f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/54f706c3-6785-4448-ade1-e033e21ed913_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/433153f4-3884-4b54-adb6-93b99d8179ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/42a5c561-0aab-48b3-a45d-ce667d7caa19_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/916f57cf-bc33-48ac-9c98-07d30ec86e76_removebg.jpg?w=600', 'https://abimg003.imgix.net/EO72RZA/2025-12-03/image/709a3194-d48c-4cf3-8482-3bc103a9405f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/23- 3K, 08/24- 5K, 08/25- 9K', 'remarks': 'VOSA STATES 9K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 92, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31dcca53-3880-4be8-a56f-4f183bd364da.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 225cf465-b214-569e-b8c5-c31acfff3508 with identifier: 117695719
2025-12-04 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 225cf465-b214-569e-b8c5-c31acfff3508 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 225cf465-b214-569e-b8c5-c31acfff3508 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 225cf465-b214-569e-b8c5-c31acfff3508, identifier: 117695719
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116409684, 'registration': 'KR67ZHM', 'account': 'GAT021', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.4 TSI SE 5dr [7 Seat]', 'mileage': 109413, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/f9c0c7d5-ca6a-46fc-be4f-6a8da8fd201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/03f8eb02-03a3-4c75-8e13-8cec7d98c0a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/eb2a48d8-91d7-4ccb-9aac-e9430e9baf10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/170890d4-acbf-4ec4-bbd5-4d834b510c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/3d9aa8d6-c2b8-40d8-a029-ba1d9e770317_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ae18bbaf-63de-4f41-99fc-66730d843b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/d8e6219c-8d10-4c73-bafa-3a50c60e1d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ad468996-8512-4ddb-b783-cfd1e26647c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/e5292ac1-1418-4a7f-b97f-a4df7c7999a3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K - 61K- 77K- 92K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6848e19e-5f32-4cd5-8c0a-0f95c90403a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116409684, 'registration': 'KR67ZHM', 'account': 'GAT021', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.4 TSI SE 5dr [7 Seat]', 'mileage': 109413, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/f9c0c7d5-ca6a-46fc-be4f-6a8da8fd201f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/03f8eb02-03a3-4c75-8e13-8cec7d98c0a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/eb2a48d8-91d7-4ccb-9aac-e9430e9baf10_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/170890d4-acbf-4ec4-bbd5-4d834b510c18_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/3d9aa8d6-c2b8-40d8-a029-ba1d9e770317_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ae18bbaf-63de-4f41-99fc-66730d843b96_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/d8e6219c-8d10-4c73-bafa-3a50c60e1d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/ad468996-8512-4ddb-b783-cfd1e26647c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR67ZHM/2025-10-17/image/e5292ac1-1418-4a7f-b97f-a4df7c7999a3_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 44K - 61K- 77K- 92K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6848e19e-5f32-4cd5-8c0a-0f95c90403a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-04 19:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c4f88cb-7210-59d3-adcd-65d787058ed8 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c4f88cb-7210-59d3-adcd-65d787058ed8 with scrape type 2
2025-12-04 19:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5c4f88cb-7210-59d3-adcd-65d787058ed8, identifier: 116409684
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117624358
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117624358%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117624358: 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 116339169
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116339169%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 116339169: 0
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Found listing with ID: 117178030
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-12-04 19:01:45 [astonbarclay.gb] INFO: Scrape type for 117178030: 2
2025-12-04 19:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a61c4883-39d1-5d0b-8307-7c32aef39e94 with identifier: 117483520
2025-12-04 19:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a61c4883-39d1-5d0b-8307-7c32aef39e94 with identifier: 117483520
2025-12-04 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a61c4883-39d1-5d0b-8307-7c32aef39e94 with identifier: 117483520 to the API
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117483520?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a61c4883-39d1-5d0b-8307-7c32aef39e94',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'M13NNH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117483520',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 48216,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-31',
 'seller_name': 'Gates Group',
 'title': 'BMW 1 SERIES HATCHBACK M135i xDrive 5dr Step Auto',
 'transmission': 'automatic',
 'trim': 'M135i xDrive 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117483520%27 HTTP/1.1" 200 None
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Saving data for 117483520: {'auction_closing_time': 1765360800.0, 'created_time': 1764184242.019716, 'last_price_update_time': 1764874906.226095}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117483520') HTTP/1.1" 204 0
2025-12-04 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 225cf465-b214-569e-b8c5-c31acfff3508 with identifier: 117695719
2025-12-04 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 225cf465-b214-569e-b8c5-c31acfff3508 with identifier: 117695719
2025-12-04 19:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 225cf465-b214-569e-b8c5-c31acfff3508 with identifier: 117695719 to the API
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27225cf465-b214-569e-b8c5-c31acfff3508%27 HTTP/1.1" 200 None
2025-12-04 19:01:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 225cf465-b214-569e-b8c5-c31acfff3508: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:45 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117695719?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 92,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '225cf465-b214-569e-b8c5-c31acfff3508',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EO72RZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117695719',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'YARIS HATCHBACK',
 'odometer': 10943,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'TOYOTA YARIS HATCHBACK 1.5 Hybrid Design 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.5 Hybrid Design 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117695719%27 HTTP/1.1" 200 None
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Saving data for 117695719: {'created_time': 1764752518.085466, 'last_price_update_time': 1764874906.51465, 'auction_closing_time': 1765360800.0}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117695719') HTTP/1.1" 204 0
2025-12-04 19:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-04 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 with identifier: 116409684
2025-12-04 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
2025-12-04 19:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5c4f88cb-7210-59d3-adcd-65d787058ed8 spider: astonbarclay.gb
2025-12-04 19:01:46 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5c4f88cb-7210-59d3-adcd-65d787058ed8 due to rule: high_mileage_for_country.json, error: 176082 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    176082
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5c4f88cb-7210-59d3-adcd-65d787058ed8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR67ZHM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116409684',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 109413,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-30',
 'seller_name': 'Gates Group',
 'title': 'SKODA KODIAQ ESTATE 1.4 TSI SE 5dr [7 Seat]',
 'transmission': 'manual',
 'trim': '1.4 TSI SE 5dr [7 Seat]',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116409684%27 HTTP/1.1" 200 None
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Saving data for 116409684: {'auction_closing_time': 1765360800.0, 'created_time': 1760554913.762837, 'last_price_update_time': 1764874906.945061}
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116409684') HTTP/1.1" 204 0
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117120682
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Scrape type for 117120682: 2
2025-12-04 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116857256?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:46 [astonbarclay.gb] INFO: Found listing with ID: 117230187
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117230187: 2
2025-12-04 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117219838
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117219838%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117219838: 0
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117353225
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117353225%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117353225: 0
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117362589
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117362589: 2
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117118656
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117118656: 2
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116857256, 'registration': 'WP19NHT', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 59233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WP19NHT/2025-10-31/image/d2e93b06-b5c1-4ecb-8447-46dd9d0d776f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/25183bfe-ea46-49c3-86b7-be945682674e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/4b84c586-e327-4930-a241-a2e5dfe41775_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/82dffc1d-28d4-4a44-9a59-b560e5a0fed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/bbfb5aac-e64f-4da2-983a-511415dd5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/401576f6-4acb-47ab-b95c-6a348fdaac57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/0cddd811-6201-4046-8d9c-e31e6e2227a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/74db46a9-9677-4f53-b01e-4f61e93772bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/c6adef3e-ac82-44f2-8f9a-4c6325c92d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/dbf8afae-9f57-4268-9dd8-3e47909a8a15_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 12/20 17K', 'remarks': 'VOSA STATES 24K - 30K - 41K- 54K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724a513a-37a8-4733-9002-648db9ecfd16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116857256, 'registration': 'WP19NHT', 'account': 'GAT001', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 ST-Line 5dr', 'mileage': 59233, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-30', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WP19NHT/2025-10-31/image/d2e93b06-b5c1-4ecb-8447-46dd9d0d776f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/25183bfe-ea46-49c3-86b7-be945682674e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/4b84c586-e327-4930-a241-a2e5dfe41775_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/82dffc1d-28d4-4a44-9a59-b560e5a0fed2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/bbfb5aac-e64f-4da2-983a-511415dd5f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/401576f6-4acb-47ab-b95c-6a348fdaac57_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/0cddd811-6201-4046-8d9c-e31e6e2227a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/74db46a9-9677-4f53-b01e-4f61e93772bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/c6adef3e-ac82-44f2-8f9a-4c6325c92d38_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19NHT/2025-10-31/image/dbf8afae-9f57-4268-9dd8-3e47909a8a15_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 12/20 17K', 'remarks': 'VOSA STATES 24K - 30K - 41K- 54K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/724a513a-37a8-4733-9002-648db9ecfd16.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-12-04 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1559227b-0549-5d03-b2a8-7e94bba4bf0b with scrape type 2
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1559227b-0549-5d03-b2a8-7e94bba4bf0b with scrape type 2
2025-12-04 19:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1559227b-0549-5d03-b2a8-7e94bba4bf0b, identifier: 116857256
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117735830, 'registration': 'YA17LZF', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A3 SALOON SPECIAL EDITIONS', 'derivative': '1.6 TDI 116 Black Edition 4dr S Tronic', 'mileage': 96745, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-15', 'fuel': 'Diesel', 'motExpiry': '2026-03-03', 'doors': 4, 'engineSize': 1598, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/18- 19k, 03/20- 49k, 01/21- 51k, 04/22- ??, 03/24- ??, 03/25- ??', 'remarks': 'VOSA STATES 62K, 71K, 81K, 91K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3ca02e5-eca8-4c16-8449-cb2b755253ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117735830, 'registration': 'YA17LZF', 'account': 'WBA002', 'make': 'AUDI', 'model': 'A3 SALOON SPECIAL EDITIONS', 'derivative': '1.6 TDI 116 Black Edition 4dr S Tronic', 'mileage': 96745, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-06-15', 'fuel': 'Diesel', 'motExpiry': '2026-03-03', 'doors': 4, 'engineSize': 1598, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600', 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 11/18- 19k, 03/20- 49k, 01/21- 51k, 04/22- ??, 03/24- ??, 03/25- ??', 'remarks': 'VOSA STATES 62K, 71K, 81K, 91K, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a3ca02e5-eca8-4c16-8449-cb2b755253ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 with identifier: 117735830
2025-12-04 19:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 with scrape type 1
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fa247937b-894c-4c89-a8fb-533e61973723_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117327029
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117327029: 2
2025-12-04 19:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-12-04 19:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256
2025-12-04 19:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1559227b-0549-5d03-b2a8-7e94bba4bf0b with identifier: 116857256 to the API
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116857256?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '1559227b-0549-5d03-b2a8-7e94bba4bf0b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WP19NHT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116857256',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 59233,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 ST-Line 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116857256%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Saving data for 116857256: {'auction_closing_time': 1765360800.0, 'created_time': 1762284369.213868, 'last_price_update_time': 1764874907.598252}
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116857256') HTTP/1.1" 204 0
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fa4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117271012
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117271012: 2
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117766955?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117245171?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117120453
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117120453: 2
2025-12-04 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117140269
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140269%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117140269: 2
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117119906
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117119906: 2
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117273524
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117273524: 2
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117444495
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117444495%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117444495: 0
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117399206
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399206%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117399206: 0
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117359464
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117359464%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117359464: 0
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Found listing with ID: 117253368
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-12-04 19:01:47 [astonbarclay.gb] INFO: Scrape type for 117253368: 2
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116802225?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117766955, 'registration': 'GU69UOE', 'account': 'MER167', 'make': 'AUDI', 'model': 'A5 CABRIOLET', 'derivative': '40 TFSI Vorsprung 2dr S Tronic', 'mileage': 26438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-12-06', 'doors': 2, 'engineSize': 1984, 'bodyType': 'Convertible', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0f9c9b1-b1f8-4d38-96cc-8b9e0649bce3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117766955, 'registration': 'GU69UOE', 'account': 'MER167', 'make': 'AUDI', 'model': 'A5 CABRIOLET', 'derivative': '40 TFSI Vorsprung 2dr S Tronic', 'mileage': 26438, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-28', 'fuel': 'Petrol', 'motExpiry': '2026-12-06', 'doors': 2, 'engineSize': 1984, 'bodyType': 'Convertible', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0f9c9b1-b1f8-4d38-96cc-8b9e0649bce3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272f69d1-30bb-5cbc-a1bc-f49cd998059e with identifier: 117766955
2025-12-04 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272f69d1-30bb-5cbc-a1bc-f49cd998059e with scrape type 1
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 272f69d1-30bb-5cbc-a1bc-f49cd998059e
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 272f69d1-30bb-5cbc-a1bc-f49cd998059e
2025-12-04 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 272f69d1-30bb-5cbc-a1bc-f49cd998059e, identifier: 117766955
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117245171, 'registration': 'LO72UVB', 'account': 'GAT009', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 20191, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a2fb0cd4-85ca-417b-84cd-be1bf478ee5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/55a2442a-f7d1-4a58-880a-34da75baed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/1da2efa8-3512-4291-9353-a72558b183d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/3745e384-ea2e-45b7-afff-d0683ebcc506_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a35df54d-c8f1-4cdb-9ef1-73cc144dc947_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/4201a444-9027-4252-9c29-6d938743a42a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/f7ee0a3e-d77e-46ae-be4d-71deef839b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/c84b2771-a499-4d8f-88e0-d8532b730530_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/e6491eb8-5e2d-451e-8c4a-860c5d8dab5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/253ca14b-760c-402c-9e78-e733b0c836c6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43042fab-3d3d-492e-9a2a-50f45098d27f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117245171, 'registration': 'LO72UVB', 'account': 'GAT009', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr', 'mileage': 20191, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-12-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a2fb0cd4-85ca-417b-84cd-be1bf478ee5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/55a2442a-f7d1-4a58-880a-34da75baed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/1da2efa8-3512-4291-9353-a72558b183d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/3745e384-ea2e-45b7-afff-d0683ebcc506_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/a35df54d-c8f1-4cdb-9ef1-73cc144dc947_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/4201a444-9027-4252-9c29-6d938743a42a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/f7ee0a3e-d77e-46ae-be4d-71deef839b1f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/c84b2771-a499-4d8f-88e0-d8532b730530_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/e6491eb8-5e2d-451e-8c4a-860c5d8dab5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO72UVB/2025-11-17/image/253ca14b-760c-402c-9e78-e733b0c836c6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'OUTSTANDING RECALL - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/43042fab-3d3d-492e-9a2a-50f45098d27f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-04 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a1e7d3a-e415-59de-a037-744b1514f421 with scrape type 2
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a1e7d3a-e415-59de-a037-744b1514f421 with scrape type 2
2025-12-04 19:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0a1e7d3a-e415-59de-a037-744b1514f421, identifier: 117245171
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117676562, 'registration': 'EK17TCJ', 'account': 'ESS008', 'make': 'FORD', 'model': 'B-MAX HATCHBACK', 'derivative': '1.0 EcoBoost Zetec Navigator 5dr', 'mileage': 56476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 9K - 03/19 19K - 02/20 24K', 'remarks': 'VOSA STATES, 35K, 41K, 47K, 53K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc574b4-9416-42cb-a5b8-369668fe21a1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117676562, 'registration': 'EK17TCJ', 'account': 'ESS008', 'make': 'FORD', 'model': 'B-MAX HATCHBACK', 'derivative': '1.0 EcoBoost Zetec Navigator 5dr', 'mileage': 56476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-06-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 03/18 9K - 03/19 19K - 02/20 24K', 'remarks': 'VOSA STATES, 35K, 41K, 47K, 53K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9dc574b4-9416-42cb-a5b8-369668fe21a1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with identifier: 117676562
2025-12-04 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with scrape type 1
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fc0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117372557
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117372557: 2
2025-12-04 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 272f69d1-30bb-5cbc-a1bc-f49cd998059e with identifier: 117766955
2025-12-04 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 272f69d1-30bb-5cbc-a1bc-f49cd998059e with identifier: 117766955
2025-12-04 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 272f69d1-30bb-5cbc-a1bc-f49cd998059e with identifier: 117766955 to the API
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27272f69d1-30bb-5cbc-a1bc-f49cd998059e%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 272f69d1-30bb-5cbc-a1bc-f49cd998059e: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117766955?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '272f69d1-30bb-5cbc-a1bc-f49cd998059e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GU69UOE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117766955',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A5 CABRIOLET',
 'odometer': 26438,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-28',
 'seller_name': 'Hedin Automotive',
 'title': 'AUDI A5 CABRIOLET 40 TFSI Vorsprung 2dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TFSI Vorsprung 2dr S Tronic',
 'vin': None,
 'year': 2019}
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117766955%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Saving data for 117766955: {'created_time': 1764874908.507186, 'last_price_update_time': 1764874908.507197, 'auction_closing_time': 1765360800.0}
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117766955') HTTP/1.1" 204 0
2025-12-04 19:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-04 19:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171
2025-12-04 19:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0a1e7d3a-e415-59de-a037-744b1514f421 with identifier: 117245171 to the API
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270a1e7d3a-e415-59de-a037-744b1514f421%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0a1e7d3a-e415-59de-a037-744b1514f421: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:47 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117245171?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0a1e7d3a-e415-59de-a037-744b1514f421',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO72UVB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117245171',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 20191,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-23',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line X 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117245171%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Saving data for 117245171: {'auction_closing_time': 1765360800.0, 'created_time': 1763146934.929353, 'last_price_update_time': 1764874908.788315}
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117245171') HTTP/1.1" 204 0
2025-12-04 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fdb84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117208422
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117208422: 2
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117215946?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Found listing with ID: 117214479
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Scrape type for 117214479: 2
2025-12-04 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116802225, 'registration': 'ET23VZJ', 'account': 'GAT019', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Active 5dr', 'mileage': 28479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-14', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/774638dc-15ce-4883-b020-80403c9586f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/623b0aa6-cb06-4571-9611-5153860db8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/0b080a7f-9969-4d50-8c03-13a1d465eff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/58d00794-e068-41a5-a8ab-4523c13084db_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/575acd9d-e147-4c91-9922-cb2c07a6184e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/2e6e9245-aee7-4cc8-a6d4-7014248ea3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/ea15b20f-e309-4ec2-be3d-f4ddb2698fc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/c0d457e3-e09b-4c17-85f0-cbbdfb78bf5c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 IN OFFICE - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc9daa0e-8933-40f5-a27e-a1d093be26f3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116802225, 'registration': 'ET23VZJ', 'account': 'GAT019', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Active 5dr', 'mileage': 28479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-14', 'fuel': 'Hybrid Electric', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/774638dc-15ce-4883-b020-80403c9586f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/623b0aa6-cb06-4571-9611-5153860db8fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/0b080a7f-9969-4d50-8c03-13a1d465eff7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/58d00794-e068-41a5-a8ab-4523c13084db_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/575acd9d-e147-4c91-9922-cb2c07a6184e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/2e6e9245-aee7-4cc8-a6d4-7014248ea3bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/ea15b20f-e309-4ec2-be3d-f4ddb2698fc0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ET23VZJ/2025-10-30/image/c0d457e3-e09b-4c17-85f0-cbbdfb78bf5c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'PHOTOCOPY OF V5 IN OFFICE - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc9daa0e-8933-40f5-a27e-a1d093be26f3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-04 19:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with scrape type 2
2025-12-04 19:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with scrape type 2
2025-12-04 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0, identifier: 116802225
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-04 19:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225
2025-12-04 19:01:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0 with identifier: 116802225 to the API
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2712f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:48 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116802225?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '12f5c5ac-f2d5-5834-9fdc-1b35d7fb5fe0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ET23VZJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116802225',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 28479,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-14',
 'seller_name': 'Gates Group',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Active 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116802225%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Saving data for 116802225: {'auction_closing_time': 1765360800.0, 'created_time': 1761814846.001401, 'last_price_update_time': 1764874909.329758}
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116802225') HTTP/1.1" 204 0
2025-12-04 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117242472
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117242472: 2
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48e9d10>
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fa4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117398180
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117398180%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117398180: 0
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117399373
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117399373%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117399373: 0
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117503025
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117503025%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117503025: 0
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Found listing with ID: 117546359
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546359%27 HTTP/1.1" 200 None
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Scrape type for 117546359: 1
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117215946, 'registration': 'AF72NTY', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 24504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8a3c2a33-901c-4d8b-95af-88c4b9d82d93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/7cd2e8c3-622d-49d1-be16-42514e7c7eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f099c4e3-694c-412c-ba29-4a63f337c64c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/a6c20e78-2d9d-4a50-af37-ecacc1e297f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/45aa1c22-e58c-4bc5-9edb-dd93773a00c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f9e77de7-68ee-443d-a386-b1d3b1ae1117_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9104fd53-926f-46c9-89b7-e1906d54abc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9354bc7a-80fd-4d12-ac14-19c91e912a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/4b209c4b-7c7d-4a70-9e39-a57d0923a4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8b0472d8-f10a-4077-854b-3c86b53b7a74_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc4b25d4-34dd-43e2-8b09-31c45c248f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117215946, 'registration': 'AF72NTY', 'account': 'GAT002', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 24504, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-10-20', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8a3c2a33-901c-4d8b-95af-88c4b9d82d93_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/7cd2e8c3-622d-49d1-be16-42514e7c7eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f099c4e3-694c-412c-ba29-4a63f337c64c_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/a6c20e78-2d9d-4a50-af37-ecacc1e297f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/45aa1c22-e58c-4bc5-9edb-dd93773a00c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/f9e77de7-68ee-443d-a386-b1d3b1ae1117_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9104fd53-926f-46c9-89b7-e1906d54abc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/9354bc7a-80fd-4d12-ac14-19c91e912a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/4b209c4b-7c7d-4a70-9e39-a57d0923a4fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AF72NTY/2025-11-14/image/8b0472d8-f10a-4077-854b-3c86b53b7a74_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 24K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fc4b25d4-34dd-43e2-8b09-31c45c248f19.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-04 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item efd85248-7020-50dd-acfc-5423a1ec9774 with scrape type 2
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item efd85248-7020-50dd-acfc-5423a1ec9774 with scrape type 2
2025-12-04 19:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: efd85248-7020-50dd-acfc-5423a1ec9774, identifier: 117215946
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117739947, 'registration': 'EX71XXS', 'account': 'WBA002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport 3dr Auto', 'mileage': 43503, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-06', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 9K, 08/24- 20K, 09/24- 22K, 11/24- 25K, 07/25- 35K, 11/25- 43K', 'remarks': 'VOSA STATES 20K, 35K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a231bf08-5dfe-4678-b8fc-c928886845c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117739947, 'registration': 'EX71XXS', 'account': 'WBA002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Sport 3dr Auto', 'mileage': 43503, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-09-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-06', 'doors': 3, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 08/23- 9K, 08/24- 20K, 09/24- 22K, 11/24- 25K, 07/25- 35K, 11/25- 43K', 'remarks': 'VOSA STATES 20K, 35K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a231bf08-5dfe-4678-b8fc-c928886845c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb6654bd-caba-5ee9-8098-76e29a0edad7 with identifier: 117739947
2025-12-04 19:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6654bd-caba-5ee9-8098-76e29a0edad7 with scrape type 1
2025-12-04 19:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 11 photos for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Ff61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117768352?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-04 19:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946
2025-12-04 19:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: efd85248-7020-50dd-acfc-5423a1ec9774 with identifier: 117215946 to the API
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27efd85248-7020-50dd-acfc-5423a1ec9774%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id efd85248-7020-50dd-acfc-5423a1ec9774: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:49 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117215946?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'efd85248-7020-50dd-acfc-5423a1ec9774',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AF72NTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117215946',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 24504,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-20',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117215946%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [astonbarclay.gb] INFO: Saving data for 117215946: {'auction_closing_time': 1765360800.0, 'created_time': 1763060610.753723, 'last_price_update_time': 1764874910.342113}
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117215946') HTTP/1.1" 204 0
2025-12-04 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 117360572
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117360572%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [astonbarclay.gb] INFO: Scrape type for 117360572: 0
2025-12-04 19:01:50 [astonbarclay.gb] INFO: Found listing with ID: 116500039
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [astonbarclay.gb] INFO: Scrape type for 116500039: 2
2025-12-04 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fd8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117770159?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fa970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a140d0>
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fc0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa5090>
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd599d9d0>
2025-12-04 19:01:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 115990741
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115990741%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 115990741: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117580703
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580703%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117580703: 2
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117768352, 'registration': 'FG66LPU', 'account': 'ARN120', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250 4Matic AMG 5dr Auto', 'mileage': 133583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 33k, 44k, 55k, 69k, 74k, 106k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117768352, 'registration': 'FG66LPU', 'account': 'ARN120', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250 4Matic AMG 5dr Auto', 'mileage': 133583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2025-11-12', 'doors': 5, 'engineSize': 1991, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 33k, 44k, 55k, 69k, 74k, 106k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eca283ed-3920-5309-a0a9-bbaa9624bfc9 with identifier: 117768352
2025-12-04 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eca283ed-3920-5309-a0a9-bbaa9624bfc9 with scrape type 1
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item eca283ed-3920-5309-a0a9-bbaa9624bfc9
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item eca283ed-3920-5309-a0a9-bbaa9624bfc9
2025-12-04 19:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eca283ed-3920-5309-a0a9-bbaa9624bfc9, identifier: 117768352
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117581450
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117581450%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117581450: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117416921
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117416921%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117416921: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117591412
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117591412%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117591412: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117707470
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117707470%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117707470: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117110106
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117110106%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117110106: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117406754
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117406754%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117406754: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117573762
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117573762%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117573762: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116013920
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116013920%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116013920: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117395964
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117395964%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117395964: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116188432
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116188432%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116188432: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117601597
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117601597%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117601597: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117599669
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599669%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117599669: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 116258586
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116258586%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 116258586: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117598315
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117598315%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117598315: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 115926008
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115926008%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 115926008: 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Found listing with ID: 117570357
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Scrape type for 117570357: 2
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fdb62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117495085?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117763389?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117768497?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eca283ed-3920-5309-a0a9-bbaa9624bfc9 with identifier: 117768352
2025-12-04 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eca283ed-3920-5309-a0a9-bbaa9624bfc9 with identifier: 117768352
2025-12-04 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'mercedes-benz a class hatchback a250 4matic amg 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'a class hatchback', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol', 'odometer': 133583, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768352', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': 'a250 4matic amg 5dr auto', 'license_plate': 'fg66lpu', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 156, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'eca283ed-3920-5309-a0a9-bbaa9624bfc9', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'mercedes-benz a class hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 214980}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'eca283ed-3920-5309-a0a9-bbaa9624bfc9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fg66lpu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768352',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz a class hatchback',
     'model': 'a class hatchback',
     'odometer': 133583,
     'odometer_in_km': 214980,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-30',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'arnold clark',
     'title': 'mercedes-benz a class hatchback a250 4matic amg 5dr auto',
     'transmission': 'automatic',
     'trim': 'a250 4matic amg 5dr auto',
     'vin': None,
     'year': 2016}
2025-12-04 19:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: eca283ed-3920-5309-a0a9-bbaa9624bfc9 spider: astonbarclay.gb
2025-12-04 19:01:51 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: eca283ed-3920-5309-a0a9-bbaa9624bfc9 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'arnold clark', 'price_includes_vat': False, 'title': 'mercedes-benz a class hatchback a250 4matic amg 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'a class hatchback', 'transmission': 'automatic', 'engine': '2.0l', 'fuel_type': 'petrol', 'odometer': 133583, 'odometer_reading_unit': 'mi', 'registration_date': '2016-09-30', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768352', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': 'a250 4matic amg 5dr auto', 'license_plate': 'fg66lpu', 'year': 2016, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 156, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'eca283ed-3920-5309-a0a9-bbaa9624bfc9', 'current_year_diff': 9, 'age_in_months': 110, 'make_model': 'mercedes-benz a class hatchback', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 214980}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 110,
     'auction_title': '',
     'c_o_2_emission_value': 156,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 9,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '2.0l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'petrol',
     'id': 'eca283ed-3920-5309-a0a9-bbaa9624bfc9',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fg66lpu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768352',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz a class hatchback',
     'model': 'a class hatchback',
     'odometer': 133583,
     'odometer_in_km': 214980,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2016-09-30',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'arnold clark',
     'title': 'mercedes-benz a class hatchback a250 4matic amg 5dr auto',
     'transmission': 'automatic',
     'trim': 'a250 4matic amg 5dr auto',
     'vin': None,
     'year': 2016}
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'eca283ed-3920-5309-a0a9-bbaa9624bfc9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FG66LPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768352',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 133583,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'Arnold Clark',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A250 4Matic AMG 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A250 4Matic AMG 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768352%27 HTTP/1.1" 200 None
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Saving data for 117768352: {'created_time': 1764874911.857063, 'last_price_update_time': 1764874911.857074, 'auction_closing_time': 1765447200.0}
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117768352') HTTP/1.1" 204 0
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117770159, 'registration': 'NA72XHW', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 32087, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@30K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:51 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117770159, 'registration': 'NA72XHW', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 32087, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2022-10-21', 'fuel': 'Petrol', 'motExpiry': '2026-10-20', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@30K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05578a90-85ed-56cc-b2f2-1489c0434781 with identifier: 117770159
2025-12-04 19:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05578a90-85ed-56cc-b2f2-1489c0434781 with scrape type 1
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 05578a90-85ed-56cc-b2f2-1489c0434781
2025-12-04 19:01:51 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 05578a90-85ed-56cc-b2f2-1489c0434781
2025-12-04 19:01:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05578a90-85ed-56cc-b2f2-1489c0434781, identifier: 117770159
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117734051, 'registration': 'LY21FYW', 'account': 'WBA002', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.3 Sport 5dr DCT', 'mileage': 17715, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600'], 'colour': 'WHITE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/22- 7K, 07/23- 9K, 06/24- 13K, 08/25- 16K', 'remarks': 'VOSA STATES 13K, 16K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24851f3a-260b-4259-a142-0a03a84b2b88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117734051, 'registration': 'LY21FYW', 'account': 'WBA002', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.3 Sport 5dr DCT', 'mileage': 17715, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600'], 'colour': 'WHITE/BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/22- 7K, 07/23- 9K, 06/24- 13K, 08/25- 16K', 'remarks': 'VOSA STATES 13K, 16K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24851f3a-260b-4259-a142-0a03a84b2b88.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d573f19d-e8b5-5c74-997b-81688dc23e79 with identifier: 117734051
2025-12-04 19:01:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d573f19d-e8b5-5c74-997b-81688dc23e79 with scrape type 1
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fbdf47719-737d-4b76-b798-ea5228610731_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fd62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05578a90-85ed-56cc-b2f2-1489c0434781 with identifier: 117770159
2025-12-04 19:01:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05578a90-85ed-56cc-b2f2-1489c0434781 with identifier: 117770159
2025-12-04 19:01:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 05578a90-85ed-56cc-b2f2-1489c0434781 with identifier: 117770159 to the API
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2705578a90-85ed-56cc-b2f2-1489c0434781%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 05578a90-85ed-56cc-b2f2-1489c0434781: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:51 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117770159?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '05578a90-85ed-56cc-b2f2-1489c0434781',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NA72XHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117770159',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 32087,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-21',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 N-Connecta 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr DCT',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117770159%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Saving data for 117770159: {'created_time': 1764874912.384701, 'last_price_update_time': 1764874912.384714, 'auction_closing_time': 1765447200.0}
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117770159') HTTP/1.1" 204 0
2025-12-04 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117217494
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217494%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117217494: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117239774
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117239774%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117239774: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117394487
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117394487%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117394487: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 116412555
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116412555%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 116412555: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117415829
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117415829%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117415829: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 116557093
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 116557093: 2
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117543749?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b2ca10>
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fe69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 117185008
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117185008%27 HTTP/1.1" 200 None
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Scrape type for 117185008: 0
2025-12-04 19:01:52 [astonbarclay.gb] INFO: Found listing with ID: 116420630
2025-12-04 19:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116420630%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Scrape type for 116420630: 0
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Found listing with ID: 116378959
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116378959%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Scrape type for 116378959: 0
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Found listing with ID: 117550264
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Scrape type for 117550264: 2
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Faa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117495085, 'registration': 'BF16LWJ', 'account': 'ARN086', 'make': 'FORD', 'model': 'B-MAX TITANIUM TURBO', 'derivative': None, 'mileage': 104423, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': None, 'engineSize': 998, 'bodyType': 'MPV', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 25k, 26k, 45k, 64k, 75k, 83k, 90k, 100k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117495085, 'registration': 'BF16LWJ', 'account': 'ARN086', 'make': 'FORD', 'model': 'B-MAX TITANIUM TURBO', 'derivative': None, 'mileage': 104423, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-31', 'fuel': 'Petrol', 'motExpiry': '2026-02-14', 'doors': None, 'engineSize': 998, 'bodyType': 'MPV', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 25k, 26k, 45k, 64k, 75k, 83k, 90k, 100k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b308ca21-30f8-5a22-ab88-818956cb7b7d with identifier: 117495085
2025-12-04 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b308ca21-30f8-5a22-ab88-818956cb7b7d with scrape type 2
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b308ca21-30f8-5a22-ab88-818956cb7b7d with scrape type 2
2025-12-04 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b308ca21-30f8-5a22-ab88-818956cb7b7d, identifier: 117495085
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117763389, 'registration': 'HN18ZKE', 'account': 'AFF012', 'make': 'BMW', 'model': '4 SERIES DIESEL CONVERTIBLE', 'derivative': '435d xDrive M Sport 2dr Auto [Professional Media]', 'mileage': 164049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-12-02', 'doors': 2, 'engineSize': 2993, 'bodyType': 'Convertible', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 66K 91K 115K 138K 158K 164K', 'virtual': False, 'seller': 'Affordable Car Finance NW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117763389, 'registration': 'HN18ZKE', 'account': 'AFF012', 'make': 'BMW', 'model': '4 SERIES DIESEL CONVERTIBLE', 'derivative': '435d xDrive M Sport 2dr Auto [Professional Media]', 'mileage': 164049, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-05-23', 'fuel': 'Diesel', 'motExpiry': '2026-12-02', 'doors': 2, 'engineSize': 2993, 'bodyType': 'Convertible', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 66K 91K 115K 138K 158K 164K', 'virtual': False, 'seller': 'Affordable Car Finance NW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 155, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4ce29d9-a5b1-5708-bda5-49ccf8909faa with identifier: 117763389
2025-12-04 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4ce29d9-a5b1-5708-bda5-49ccf8909faa with scrape type 1
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c4ce29d9-a5b1-5708-bda5-49ccf8909faa
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c4ce29d9-a5b1-5708-bda5-49ccf8909faa
2025-12-04 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c4ce29d9-a5b1-5708-bda5-49ccf8909faa, identifier: 117763389
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117768497, 'registration': 'PM20HLS', 'account': 'ARN243', 'make': 'PORSCHE', 'model': 'MACAN ESTATE', 'derivative': 'S 5dr PDK', 'mileage': 64636, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 28k, 30k, 42k, 58k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 204, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117768497, 'registration': 'PM20HLS', 'account': 'ARN243', 'make': 'PORSCHE', 'model': 'MACAN ESTATE', 'derivative': 'S 5dr PDK', 'mileage': 64636, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-01', 'fuel': 'Petrol', 'motExpiry': '2026-07-02', 'doors': 5, 'engineSize': 2995, 'bodyType': 'Estate', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 28k, 30k, 42k, 58k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 204, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cca96e-72d2-5d05-bf15-5751e186495b with identifier: 117768497
2025-12-04 19:01:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8cca96e-72d2-5d05-bf15-5751e186495b with scrape type 1
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item c8cca96e-72d2-5d05-bf15-5751e186495b
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item c8cca96e-72d2-5d05-bf15-5751e186495b
2025-12-04 19:01:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c8cca96e-72d2-5d05-bf15-5751e186495b, identifier: 117768497
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48f4810>
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b308ca21-30f8-5a22-ab88-818956cb7b7d with identifier: 117495085
2025-12-04 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b308ca21-30f8-5a22-ab88-818956cb7b7d with identifier: 117495085
2025-12-04 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168052
2025-12-04 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b308ca21-30f8-5a22-ab88-818956cb7b7d spider: astonbarclay.gb
2025-12-04 19:01:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b308ca21-30f8-5a22-ab88-818956cb7b7d due to rule: high_mileage_for_country.json, error: 168052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168052
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': None,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b308ca21-30f8-5a22-ab88-818956cb7b7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BF16LWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117495085',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'B-MAX TITANIUM TURBO',
 'odometer': 104423,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-31',
 'seller_name': 'Arnold Clark',
 'title': 'FORD B-MAX TITANIUM TURBO None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2016}
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495085%27 HTTP/1.1" 200 None
2025-12-04 19:01:53 [astonbarclay.gb] INFO: Saving data for 117495085: {'auction_closing_time': 1765447200.0, 'created_time': 1764097529.610213, 'last_price_update_time': 1764874913.973261}
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117495085') HTTP/1.1" 204 0
2025-12-04 19:01:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c4ce29d9-a5b1-5708-bda5-49ccf8909faa with identifier: 117763389
2025-12-04 19:01:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c4ce29d9-a5b1-5708-bda5-49ccf8909faa with identifier: 117763389
2025-12-04 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'affordable car finance nw', 'price_includes_vat': False, 'title': 'bmw 4 series diesel convertible 435d xdrive m sport 2dr auto [professional media]', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '4 series diesel convertible', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 164049, 'odometer_reading_unit': 'mi', 'registration_date': '2018-05-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763389', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '435d xdrive m sport 2dr auto [professional media]', 'license_plate': 'hn18zke', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 2, 'c_o_2_emission_value': 155, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'c4ce29d9-a5b1-5708-bda5-49ccf8909faa', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'bmw 4 series diesel convertible', 'sanitized_make': 'bmw', 'odometer_in_km': 264010}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 155,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 2,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'diesel',
     'id': 'c4ce29d9-a5b1-5708-bda5-49ccf8909faa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hn18zke',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763389',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'bmw',
     'make_model': 'bmw 4 series diesel convertible',
     'model': '4 series diesel convertible',
     'odometer': 164049,
     'odometer_in_km': 264010,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-05-23',
     'sanitized_make': 'bmw',
     'seller_name': 'affordable car finance nw',
     'title': 'bmw 4 series diesel convertible 435d xdrive m sport 2dr '
              'auto [professional media]',
     'transmission': 'automatic',
     'trim': '435d xdrive m sport 2dr auto [professional media]',
     'vin': None,
     'year': 2018}
2025-12-04 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: c4ce29d9-a5b1-5708-bda5-49ccf8909faa spider: astonbarclay.gb
2025-12-04 19:01:54 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c4ce29d9-a5b1-5708-bda5-49ccf8909faa due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'affordable car finance nw', 'price_includes_vat': False, 'title': 'bmw 4 series diesel convertible 435d xdrive m sport 2dr auto [professional media]', 'price': 0, 'currency': 'gbp', 'make': 'bmw', 'model': '4 series diesel convertible', 'transmission': 'automatic', 'engine': '3.0l', 'fuel_type': 'diesel', 'odometer': 164049, 'odometer_reading_unit': 'mi', 'registration_date': '2018-05-23', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763389', 'expiration_date': '2025-12-11t10:00:00z', 'location': 'aston barclay prees heath', 'origin_country_code': 'gb', 'trim': '435d xdrive m sport 2dr auto [professional media]', 'license_plate': 'hn18zke', 'year': 2018, 'vin': None, 'listing': 'auction', 'doors_number': 2, 'c_o_2_emission_value': 155, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'c4ce29d9-a5b1-5708-bda5-49ccf8909faa', 'current_year_diff': 7, 'age_in_months': 90, 'make_model': 'bmw 4 series diesel convertible', 'sanitized_make': 'bmw', 'odometer_in_km': 264010}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 90,
     'auction_title': '',
     'c_o_2_emission_value': 155,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 7,
     'doors_number': 2,
     'emission_standard': 'euro 6',
     'engine': '3.0l',
     'expiration_date': '2025-12-11t10:00:00z',
     'fuel_type': 'diesel',
     'id': 'c4ce29d9-a5b1-5708-bda5-49ccf8909faa',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'hn18zke',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763389',
     'listing': 'auction',
     'location': 'aston barclay prees heath',
     'make': 'bmw',
     'make_model': 'bmw 4 series diesel convertible',
     'model': '4 series diesel convertible',
     'odometer': 164049,
     'odometer_in_km': 264010,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2018-05-23',
     'sanitized_make': 'bmw',
     'seller_name': 'affordable car finance nw',
     'title': 'bmw 4 series diesel convertible 435d xdrive m sport 2dr '
              'auto [professional media]',
     'transmission': 'automatic',
     'trim': '435d xdrive m sport 2dr auto [professional media]',
     'vin': None,
     'year': 2018}
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'c4ce29d9-a5b1-5708-bda5-49ccf8909faa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HN18ZKE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763389',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'BMW',
 'model': '4 SERIES DIESEL CONVERTIBLE',
 'odometer': 164049,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-23',
 'seller_name': 'Affordable Car Finance NW',
 'title': 'BMW 4 SERIES DIESEL CONVERTIBLE 435d xDrive M Sport 2dr Auto '
          '[Professional Media]',
 'transmission': 'automatic',
 'trim': '435d xDrive M Sport 2dr Auto [Professional Media]',
 'vin': None,
 'year': 2018}
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763389%27 HTTP/1.1" 200 None
2025-12-04 19:01:54 [astonbarclay.gb] INFO: Saving data for 117763389: {'created_time': 1764874914.210306, 'last_price_update_time': 1764874914.210317, 'auction_closing_time': 1765447200.0}
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117763389') HTTP/1.1" 204 0
2025-12-04 19:01:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c8cca96e-72d2-5d05-bf15-5751e186495b with identifier: 117768497
2025-12-04 19:01:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c8cca96e-72d2-5d05-bf15-5751e186495b with identifier: 117768497
2025-12-04 19:01:54 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c8cca96e-72d2-5d05-bf15-5751e186495b with identifier: 117768497 to the API
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c8cca96e-72d2-5d05-bf15-5751e186495b%27 HTTP/1.1" 200 None
2025-12-04 19:01:54 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c8cca96e-72d2-5d05-bf15-5751e186495b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:53 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117768497?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 204,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c8cca96e-72d2-5d05-bf15-5751e186495b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PM20HLS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768497',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'PORSCHE',
 'model': 'MACAN ESTATE',
 'odometer': 64636,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-01',
 'seller_name': 'Arnold Clark',
 'title': 'PORSCHE MACAN ESTATE S 5dr PDK',
 'transmission': 'automatic',
 'trim': 'S 5dr PDK',
 'vin': None,
 'year': 2020}
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768497%27 HTTP/1.1" 200 None
2025-12-04 19:01:54 [astonbarclay.gb] INFO: Saving data for 117768497: {'created_time': 1764874914.547691, 'last_price_update_time': 1764874914.547703, 'auction_closing_time': 1765447200.0}
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117768497') HTTP/1.1" 204 0
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47ac090>
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fd8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47b59d0>
2025-12-04 19:01:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Ff61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117543749, 'registration': 'DT17FYC', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T Design 5dr', 'mileage': 86936, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-07-11', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DT17FYC/2025-11-27/image/c9842a3d-7a60-489f-8a88-fb03ffe22650_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/80b25ae1-be29-4bc4-8b9f-71fbe6305b86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/d35fd650-6961-4115-82c4-512638698987_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/e70459b9-c60c-4388-80dd-c164025cf630_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/8cf8f2e4-a003-453b-adec-9b9123ef48e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/378d56f3-fdb1-44f7-b5c7-b38dca165ebf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/df2e9cd0-0abc-4461-961c-85fd35436332_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/1449d5ab-c7ba-4483-a374-4761140f3e22_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '02/20-44K, 10/20-46K, 08/25-86K', 'remarks': 'VOSA STATES 46K 49K 60K 62K 70K 81K 86K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/692f3646-976e-495b-ac76-12a3af29e015.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117543749, 'registration': 'DT17FYC', 'account': 'STE131', 'make': 'VAUXHALL', 'model': 'ZAFIRA TOURER', 'derivative': '1.4T Design 5dr', 'mileage': 86936, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-07-11', 'fuel': 'Petrol', 'motExpiry': '2026-09-09', 'doors': 5, 'engineSize': 1364, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/DT17FYC/2025-11-27/image/c9842a3d-7a60-489f-8a88-fb03ffe22650_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/80b25ae1-be29-4bc4-8b9f-71fbe6305b86_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/d35fd650-6961-4115-82c4-512638698987_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/e70459b9-c60c-4388-80dd-c164025cf630_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/8cf8f2e4-a003-453b-adec-9b9123ef48e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/378d56f3-fdb1-44f7-b5c7-b38dca165ebf_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/df2e9cd0-0abc-4461-961c-85fd35436332_removebg.jpg?w=600', 'https://abimg003.imgix.net/DT17FYC/2025-11-27/image/1449d5ab-c7ba-4483-a374-4761140f3e22_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '02/20-44K, 10/20-46K, 08/25-86K', 'remarks': 'VOSA STATES 46K 49K 60K 62K 70K 81K 86K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 156, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/692f3646-976e-495b-ac76-12a3af29e015.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:01:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with identifier: 117543749
2025-12-04 19:01:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with scrape type 2
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with scrape type 2
2025-12-04 19:01:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d53b03aa-dd08-5abc-9e6c-550b4998d8f0, identifier: 117543749
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:55 [astonbarclay.gb] INFO: Found listing with ID: 116504950
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-12-04 19:01:55 [astonbarclay.gb] INFO: Scrape type for 116504950: 2
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with identifier: 117543749
2025-12-04 19:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with identifier: 117543749
2025-12-04 19:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d53b03aa-dd08-5abc-9e6c-550b4998d8f0 with identifier: 117543749 to the API
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d53b03aa-dd08-5abc-9e6c-550b4998d8f0%27 HTTP/1.1" 200 None
2025-12-04 19:01:55 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d53b03aa-dd08-5abc-9e6c-550b4998d8f0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:01:54 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:01:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117543749?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 156,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd53b03aa-dd08-5abc-9e6c-550b4998d8f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DT17FYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117543749',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'ZAFIRA TOURER',
 'odometer': 86936,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-11',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'VAUXHALL ZAFIRA TOURER 1.4T Design 5dr',
 'transmission': 'manual',
 'trim': '1.4T Design 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117543749%27 HTTP/1.1" 200 None
2025-12-04 19:01:55 [astonbarclay.gb] INFO: Saving data for 117543749: {'auction_closing_time': 1765447200.0, 'created_time': 1764184316.739845, 'last_price_update_time': 1764874915.590268}
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117543749') HTTP/1.1" 204 0
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117271012?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117120682?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117178030?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4784550>
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fa970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:56 [astonbarclay.gb] INFO: Found listing with ID: 116645477
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-12-04 19:01:56 [astonbarclay.gb] INFO: Scrape type for 116645477: 2
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fb8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Ff81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a67ed0>
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fbdf47719-737d-4b76-b798-ea5228610731_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd683c590>
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fdb62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a66910>
2025-12-04 19:01:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a36410>
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117023136
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023136%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117023136: 0
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117599419
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599419%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117599419: 0
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117492820
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117492820%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117492820: 0
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117460295
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117460295%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117460295: 0
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117625956
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117625956%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117625956: 0
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Found listing with ID: 117547683
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [astonbarclay.gb] INFO: Scrape type for 117547683: 2
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fc3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:01:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117753214?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47a8d50>
2025-12-04 19:01:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:01:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fd62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600 saved to cache
2025-12-04 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117271012, 'registration': 'HY72LBA', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 31689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-28', 'fuel': 'Electric', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HY72LBA/2025-11-17/image/01c381c3-b6e4-4635-8203-51f5c4e24beb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/56a282bc-2e1f-4f82-9584-fa7a187ca380_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/f62029b1-404a-47f1-a57c-bc79d32abb52_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/67d29376-6097-4d90-81fa-2e26c80b1a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/8901edeb-9f53-478d-a3c8-b7c893283dfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/fd3ecbaf-fd5e-47c5-b765-e3568fbe76c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/61365c0c-8e1f-444c-b472-1c961d4fb2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/285a0d5d-7ac4-44e8-93bb-a0241950ef60_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/23948964-f33d-4bd7-b30d-4acf7112d6de_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 21K', 'remarks': '**989**VOSA STATES 30K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f1650b3-6b2f-4265-98c1-3038c5f17d58.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117271012, 'registration': 'HY72LBA', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V2 58kWh 5dr Auto', 'mileage': 31689, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-28', 'fuel': 'Electric', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HY72LBA/2025-11-17/image/01c381c3-b6e4-4635-8203-51f5c4e24beb_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/56a282bc-2e1f-4f82-9584-fa7a187ca380_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/f62029b1-404a-47f1-a57c-bc79d32abb52_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/67d29376-6097-4d90-81fa-2e26c80b1a7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/8901edeb-9f53-478d-a3c8-b7c893283dfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/fd3ecbaf-fd5e-47c5-b765-e3568fbe76c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/61365c0c-8e1f-444c-b472-1c961d4fb2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/285a0d5d-7ac4-44e8-93bb-a0241950ef60_removebg.jpg?w=600', 'https://abimg003.imgix.net/HY72LBA/2025-11-17/image/23948964-f33d-4bd7-b30d-4acf7112d6de_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 21K', 'remarks': '**989**VOSA STATES 30K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4f1650b3-6b2f-4265-98c1-3038c5f17d58.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 with identifier: 117271012
2025-12-04 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59, identifier: 117271012
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117120682, 'registration': 'SJ72ONS', 'account': 'KIN032', 'make': 'SEAT', 'model': 'ATECA DIESEL ESTATE', 'derivative': '2.0 TDI 150 SE 5dr', 'mileage': 36677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/71509572-defa-4124-a3f0-21283fb501bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/47fe72b9-679b-4594-9992-667108894804_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/d30323f7-36f9-4464-9afd-66334dc454c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/6010eb32-79f4-46ba-9ebe-2738c656f38e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/5c149f5e-5022-4f4b-a273-939b5206c0e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/3c7624a9-a4d4-457d-96a0-b540315ef314_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/79bba63a-7f16-492f-8516-83c05b2dce18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/95b29299-3dc8-4644-b5b4-94975ba7c3ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/950c7d09-7610-467f-82f0-bf7cfedad498_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 - 13K', 'remarks': '**317** VOSA STATES 33K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/28520a83-f0bd-48b7-9f06-2cf510ebcb69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117120682, 'registration': 'SJ72ONS', 'account': 'KIN032', 'make': 'SEAT', 'model': 'ATECA DIESEL ESTATE', 'derivative': '2.0 TDI 150 SE 5dr', 'mileage': 36677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-09-09', 'fuel': 'Diesel', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/71509572-defa-4124-a3f0-21283fb501bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/47fe72b9-679b-4594-9992-667108894804_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/d30323f7-36f9-4464-9afd-66334dc454c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/6010eb32-79f4-46ba-9ebe-2738c656f38e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/5c149f5e-5022-4f4b-a273-939b5206c0e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/3c7624a9-a4d4-457d-96a0-b540315ef314_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/79bba63a-7f16-492f-8516-83c05b2dce18_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/95b29299-3dc8-4644-b5b4-94975ba7c3ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ72ONS/2025-11-11/image/950c7d09-7610-467f-82f0-bf7cfedad498_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/23 - 13K', 'remarks': '**317** VOSA STATES 33K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/28520a83-f0bd-48b7-9f06-2cf510ebcb69.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with identifier: 117120682
2025-12-04 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac, identifier: 117120682
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117178030, 'registration': 'GU72OZV', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 30558, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-14', 'fuel': 'Electric', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72OZV/2025-11-12/image/97d5b082-8833-4350-8ef0-ec47d9e11ee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/5419618f-0af4-4c79-bfe0-1894d04cde71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/49b8f7a5-db7b-4167-aee1-77c2674e2239_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/e14f0274-0e63-424c-86a3-6cd6ac54a420_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/63ae9470-d71d-40b6-8864-a6d116b0532b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/d9baff0a-e9aa-4732-b99e-25e4ec018da6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/c7775aa2-2bd3-4bce-8a66-072f8da49963_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/e4ec3152-7ec6-418b-8732-71b11172cd36_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/36dfe218-493e-4a55-9faf-0a17b867400a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 10K, 01/25 - 22K', 'remarks': '**124** VOSA STATES 27K, SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54b83bdb-ab3f-4427-9836-29951e1f71b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117178030, 'registration': 'GU72OZV', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'EQC ESTATE', 'derivative': 'EQC 400 300kW AMG Line 80kWh 5dr Auto', 'mileage': 30558, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-14', 'fuel': 'Electric', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GU72OZV/2025-11-12/image/97d5b082-8833-4350-8ef0-ec47d9e11ee1_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/5419618f-0af4-4c79-bfe0-1894d04cde71_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/49b8f7a5-db7b-4167-aee1-77c2674e2239_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/e14f0274-0e63-424c-86a3-6cd6ac54a420_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/63ae9470-d71d-40b6-8864-a6d116b0532b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/d9baff0a-e9aa-4732-b99e-25e4ec018da6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/c7775aa2-2bd3-4bce-8a66-072f8da49963_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/e4ec3152-7ec6-418b-8732-71b11172cd36_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72OZV/2025-11-12/image/36dfe218-493e-4a55-9faf-0a17b867400a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/24 - 10K, 01/25 - 22K', 'remarks': '**124** VOSA STATES 27K, SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/54b83bdb-ab3f-4427-9836-29951e1f71b0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:01:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4adfaf0-d980-580d-b691-fe39f2cba45f with identifier: 117178030
2025-12-04 19:01:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4adfaf0-d980-580d-b691-fe39f2cba45f with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4adfaf0-d980-580d-b691-fe39f2cba45f with scrape type 2
2025-12-04 19:01:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a4adfaf0-d980-580d-b691-fe39f2cba45f, identifier: 117178030
2025-12-04 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117327029?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 with identifier: 117271012
2025-12-04 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 with identifier: 117271012
2025-12-04 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 31689, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271012', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'hy72lba', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '05a8b420-90ee-5f8c-bee6-4e5fb5f98d59', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 50998} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '05a8b420-90ee-5f8c-bee6-4e5fb5f98d59',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'hy72lba',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271012',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 31689,
     'odometer_in_km': 50998,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-28',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 spider: astonbarclay.gb
2025-12-04 19:01:58 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 05a8b420-90ee-5f8c-bee6-4e5fb5f98d59 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 31689, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271012', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw v2 58kwh 5dr auto', 'license_plate': 'hy72lba', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '05a8b420-90ee-5f8c-bee6-4e5fb5f98d59', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 50998} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '05a8b420-90ee-5f8c-bee6-4e5fb5f98d59',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'hy72lba',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271012',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 31689,
     'odometer_in_km': 50998,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-28',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v2 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v2 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '05a8b420-90ee-5f8c-bee6-4e5fb5f98d59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HY72LBA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117271012',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 31689,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-28',
 'seller_name': 'Kinto',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V2 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V2 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117271012%27 HTTP/1.1" 200 None
2025-12-04 19:01:58 [astonbarclay.gb] INFO: Saving data for 117271012: {'auction_closing_time': 1765532700.0, 'created_time': 1764097549.696627, 'last_price_update_time': 1764874918.735025}
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117271012') HTTP/1.1" 204 0
2025-12-04 19:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with identifier: 117120682
2025-12-04 19:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with identifier: 117120682
2025-12-04 19:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac with identifier: 117120682 to the API
2025-12-04 19:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117120682?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'a1596ce2-7c35-50a2-aa4c-dfdb77e0c2ac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SJ72ONS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117120682',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'SEAT',
 'model': 'ATECA DIESEL ESTATE',
 'odometer': 36677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-09',
 'seller_name': 'Kinto',
 'title': 'SEAT ATECA DIESEL ESTATE 2.0 TDI 150 SE 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI 150 SE 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120682%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Saving data for 117120682: {'auction_closing_time': 1765532700.0, 'created_time': 1763579016.297487, 'last_price_update_time': 1764874920.060816}
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117120682') HTTP/1.1" 204 0
2025-12-04 19:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a4adfaf0-d980-580d-b691-fe39f2cba45f with identifier: 117178030
2025-12-04 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a4adfaf0-d980-580d-b691-fe39f2cba45f with identifier: 117178030
2025-12-04 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30558, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178030', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72ozv', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a4adfaf0-d980-580d-b691-fe39f2cba45f', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 49178} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': 'a4adfaf0-d980-580d-b691-fe39f2cba45f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72ozv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178030',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 30558,
     'odometer_in_km': 49178,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: a4adfaf0-d980-580d-b691-fe39f2cba45f spider: astonbarclay.gb
2025-12-04 19:02:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a4adfaf0-d980-580d-b691-fe39f2cba45f due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mercedes-benz', 'model': 'eqc estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30558, 'odometer_reading_unit': 'mi', 'registration_date': '2022-09-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178030', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': 'eqc 400 300kw amg line 80kwh 5dr auto', 'license_plate': 'gu72ozv', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'a4adfaf0-d980-580d-b691-fe39f2cba45f', 'current_year_diff': 3, 'age_in_months': 38, 'make_model': 'mercedes-benz eqc estate', 'sanitized_make': 'mercedesbenz', 'odometer_in_km': 49178} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 38,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': 'a4adfaf0-d980-580d-b691-fe39f2cba45f',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'gu72ozv',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178030',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'mercedes-benz',
     'make_model': 'mercedes-benz eqc estate',
     'model': 'eqc estate',
     'odometer': 30558,
     'odometer_in_km': 49178,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-09-14',
     'sanitized_make': 'mercedesbenz',
     'seller_name': 'kinto',
     'title': 'mercedes-benz eqc estate eqc 400 300kw amg line 80kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': 'eqc 400 300kw amg line 80kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': 'a4adfaf0-d980-580d-b691-fe39f2cba45f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72OZV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117178030',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'EQC ESTATE',
 'odometer': 30558,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-14',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ EQC ESTATE EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': 'EQC 400 300kW AMG Line 80kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117178030%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Saving data for 117178030: {'auction_closing_time': 1765532700.0, 'created_time': 1763751869.428675, 'last_price_update_time': 1764874920.753122}
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117178030') HTTP/1.1" 204 0
2025-12-04 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117771342
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117771342%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117771342: 1
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fe87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117208422?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117214479?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Found listing with ID: 117642361
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642361%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Scrape type for 117642361: 2
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117242472?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117753214, 'registration': 'KX19WTU', 'account': 'MOT075', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '220i Luxury 5dr DCT', 'mileage': 64010, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2025-10-09', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d19b00b-2eb3-4518-ac3b-5c9069857637.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:00 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117753214, 'registration': 'KX19WTU', 'account': 'MOT075', 'make': 'BMW', 'model': '2 SERIES GRAN TOURER', 'derivative': '220i Luxury 5dr DCT', 'mileage': 64010, 'mileageWarranty': True, 'type': 'car', 'saleId': 17999, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-09T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2025-10-09', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9d19b00b-2eb3-4518-ac3b-5c9069857637.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bef5d851-76e8-502c-bc12-1e5fa273df70 with identifier: 117753214
2025-12-04 19:02:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bef5d851-76e8-502c-bc12-1e5fa273df70 with scrape type 1
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bef5d851-76e8-502c-bc12-1e5fa273df70
2025-12-04 19:02:00 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bef5d851-76e8-502c-bc12-1e5fa273df70
2025-12-04 19:02:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bef5d851-76e8-502c-bc12-1e5fa273df70, identifier: 117753214
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa8710>
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Faa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa4bd0>
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47cedd0>
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6afa250>
2025-12-04 19:02:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252Fe69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:02:02 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117327029, 'registration': 'GU72XWC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK SPECIAL EDITIONS', 'derivative': 'GLA 250e Exclusive Edition Premium Plus 5dr Auto', 'mileage': 40119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-21', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU72XWC/2025-11-19/image/5d8684fd-1967-496f-92f2-6273a19e6b08_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/8bb9dbd9-c06c-4d5a-9f78-ccd65e725dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/bf36a4f2-2963-405f-aa15-3492687e31d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/82e8b08c-bb6c-4f6f-a39a-0118ed2aed21_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/e3ec82fe-7ce2-4e60-99fe-cd01fe402c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/bd5dc44c-3d37-4b36-a29b-a6ea6b6b4cdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/f25ac03f-7f84-4409-92a8-d957fb4e713e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/a7c55e97-ac1b-4e8f-abb8-5b8b867f0f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/ca83c6fe-0891-4b00-a936-6493ff46f511_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/23- 12K, 09/25- 38K,', 'remarks': '**285**VOSA STATES 38K CHARGING CABLE  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31b8ab39-4ca1-4e33-9765-df70c23b1cb0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:02 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117327029, 'registration': 'GU72XWC', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'GLA HATCHBACK SPECIAL EDITIONS', 'derivative': 'GLA 250e Exclusive Edition Premium Plus 5dr Auto', 'mileage': 40119, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-09-21', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-09-20', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GU72XWC/2025-11-19/image/5d8684fd-1967-496f-92f2-6273a19e6b08_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/8bb9dbd9-c06c-4d5a-9f78-ccd65e725dec_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/bf36a4f2-2963-405f-aa15-3492687e31d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/82e8b08c-bb6c-4f6f-a39a-0118ed2aed21_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/e3ec82fe-7ce2-4e60-99fe-cd01fe402c5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/bd5dc44c-3d37-4b36-a29b-a6ea6b6b4cdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/f25ac03f-7f84-4409-92a8-d957fb4e713e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/a7c55e97-ac1b-4e8f-abb8-5b8b867f0f07_removebg.jpg?w=600', 'https://abimg003.imgix.net/GU72XWC/2025-11-19/image/ca83c6fe-0891-4b00-a936-6493ff46f511_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/23- 12K, 09/25- 38K,', 'remarks': '**285**VOSA STATES 38K CHARGING CABLE  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 34, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/31b8ab39-4ca1-4e33-9765-df70c23b1cb0.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with identifier: 117327029
2025-12-04 19:02:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with scrape type 2
2025-12-04 19:02:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with scrape type 2
2025-12-04 19:02:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0dd7e4bc-092d-5d45-8c95-05bc416b1729, identifier: 117327029
2025-12-04 19:02:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bef5d851-76e8-502c-bc12-1e5fa273df70 with identifier: 117753214
2025-12-04 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bef5d851-76e8-502c-bc12-1e5fa273df70 with identifier: 117753214
2025-12-04 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bef5d851-76e8-502c-bc12-1e5fa273df70 with identifier: 117753214 to the API
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27bef5d851-76e8-502c-bc12-1e5fa273df70%27 HTTP/1.1" 200 None
2025-12-04 19:02:02 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id bef5d851-76e8-502c-bc12-1e5fa273df70: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:01 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117753214?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'bef5d851-76e8-502c-bc12-1e5fa273df70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KX19WTU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117753214',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'BMW',
 'model': '2 SERIES GRAN TOURER',
 'odometer': 64010,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': 'MotoNovo Finance',
 'title': 'BMW 2 SERIES GRAN TOURER 220i Luxury 5dr DCT',
 'transmission': 'automatic',
 'trim': '220i Luxury 5dr DCT',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117753214%27 HTTP/1.1" 200 None
2025-12-04 19:02:02 [astonbarclay.gb] INFO: Saving data for 117753214: {'created_time': 1764874922.565219, 'last_price_update_time': 1764874922.565231, 'auction_closing_time': 1765274400.0}
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117753214') HTTP/1.1" 204 0
2025-12-04 19:02:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with identifier: 117327029
2025-12-04 19:02:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with identifier: 117327029
2025-12-04 19:02:02 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0dd7e4bc-092d-5d45-8c95-05bc416b1729 with identifier: 117327029 to the API
2025-12-04 19:02:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117327029?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 34,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '0dd7e4bc-092d-5d45-8c95-05bc416b1729',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'GU72XWC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117327029',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'GLA HATCHBACK SPECIAL EDITIONS',
 'odometer': 40119,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-21',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ GLA HATCHBACK SPECIAL EDITIONS GLA 250e Exclusive '
          'Edition Premium Plus 5dr Auto',
 'transmission': 'automatic',
 'trim': 'GLA 250e Exclusive Edition Premium Plus 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117327029%27 HTTP/1.1" 200 None
2025-12-04 19:02:03 [astonbarclay.gb] INFO: Saving data for 117327029: {'auction_closing_time': 1765532700.0, 'created_time': 1764097551.792181, 'last_price_update_time': 1764874923.559741}
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117327029') HTTP/1.1" 204 0
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:03 [astonbarclay.gb] INFO: Found listing with ID: 117767677
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767677%27 HTTP/1.1" 200 None
2025-12-04 19:02:03 [astonbarclay.gb] INFO: Scrape type for 117767677: 1
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a17390>
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ef5190>
2025-12-04 19:02:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117208422, 'registration': 'BJ72VTG', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V1 58kWh 5dr Auto', 'mileage': 27175, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-14', 'fuel': 'Electric', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/a3d302a5-df5f-4b48-b971-1c2eb13337c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/dcef7cf4-cd1f-47da-8158-fd5cd4974e60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/b61b39b8-9a06-4488-a88e-a3b30e17c673_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/43681d96-ea45-4bcc-9c95-1caa9c5768e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/575d750b-99c8-4e13-a227-cfeb931575d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/5e788cbf-2c49-4dd3-a36e-896e3fbe98c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/4905d9ac-8379-425b-b8a3-e988958f4b14_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/47f8d7db-ab43-4870-8979-f0445cabf0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/72faabc0-dae4-4065-8abf-fd7ea2758a1b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 17K', 'remarks': '**273**VOSA STATES 26K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/365eda8f-6e5b-473b-9850-891278c692a6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117208422, 'registration': 'BJ72VTG', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'BORN ELECTRIC HATCHBACK', 'derivative': '150kW V1 58kWh 5dr Auto', 'mileage': 27175, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-14', 'fuel': 'Electric', 'motExpiry': '2026-11-13', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/a3d302a5-df5f-4b48-b971-1c2eb13337c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/dcef7cf4-cd1f-47da-8158-fd5cd4974e60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/b61b39b8-9a06-4488-a88e-a3b30e17c673_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/43681d96-ea45-4bcc-9c95-1caa9c5768e0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/575d750b-99c8-4e13-a227-cfeb931575d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/5e788cbf-2c49-4dd3-a36e-896e3fbe98c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/4905d9ac-8379-425b-b8a3-e988958f4b14_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/47f8d7db-ab43-4870-8979-f0445cabf0b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BJ72VTG/2025-11-13/image/72faabc0-dae4-4065-8abf-fd7ea2758a1b_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24 - 17K', 'remarks': '**273**VOSA STATES 26K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/365eda8f-6e5b-473b-9850-891278c692a6.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ac408dc-0d02-55a9-8e88-b7175b34b18b with identifier: 117208422
2025-12-04 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ac408dc-0d02-55a9-8e88-b7175b34b18b with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ac408dc-0d02-55a9-8e88-b7175b34b18b with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9ac408dc-0d02-55a9-8e88-b7175b34b18b, identifier: 117208422
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117214479, 'registration': 'YR22TLY', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ST-LINE PHEV CVT', 'derivative': None, 'mileage': 42553, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-09', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR22TLY/2025-11-14/image/84d83a9e-0063-4029-886b-9a41253f41dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d411ae85-102e-469f-85f6-0acf8995f1d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d88d5590-f1bf-4429-a025-c7ce68ff576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c147a912-69f5-4982-bf1f-d83d9c7e6e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/6cc343a7-4ed3-4d05-9b47-087d9411bdb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c821dd3f-a077-4cce-a6ea-ebced10e43f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d145600c-f966-4a0c-8eef-9bf3bbdaa698_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/80b38633-36f6-4424-86c6-ce64a4928bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c4a6b1b8-443b-4da7-bd64-b688cd3c3758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23 - 11K, 05/25 - 35K', 'remarks': '**284**VOSA STATES 35K CHARGING CABLE  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e94d719-9c99-4a38-a966-26311f041087.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117214479, 'registration': 'YR22TLY', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ST-LINE PHEV CVT', 'derivative': None, 'mileage': 42553, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-05-09', 'fuel': 'Hybrid Electric', 'motExpiry': '2026-05-08', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR22TLY/2025-11-14/image/84d83a9e-0063-4029-886b-9a41253f41dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d411ae85-102e-469f-85f6-0acf8995f1d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d88d5590-f1bf-4429-a025-c7ce68ff576a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c147a912-69f5-4982-bf1f-d83d9c7e6e80_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/6cc343a7-4ed3-4d05-9b47-087d9411bdb3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c821dd3f-a077-4cce-a6ea-ebced10e43f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/d145600c-f966-4a0c-8eef-9bf3bbdaa698_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/80b38633-36f6-4424-86c6-ce64a4928bef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22TLY/2025-11-14/image/c4a6b1b8-443b-4da7-bd64-b688cd3c3758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/23 - 11K, 05/25 - 35K', 'remarks': '**284**VOSA STATES 35K CHARGING CABLE  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 23, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0e94d719-9c99-4a38-a966-26311f041087.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with identifier: 117214479
2025-12-04 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 18ec308d-7b66-5a4e-bae9-5674bd4c7926, identifier: 117214479
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117242472, 'registration': 'YP72TVN', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 20163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP72TVN/2025-11-17/image/1f9ffe5c-1b72-4046-920b-fd1f9067e9a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/b53e35c9-b2d8-4964-81da-b088e52bbe43_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/dff8a23f-9015-4aa1-9071-eb1fb96cc499_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/75d0b357-c8aa-4207-91a2-6e006c8d2cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/12bbcaec-c7da-4628-ac9d-245cd12f8812_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/ab169617-305a-4950-8595-af41aa5dafa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/62730781-054a-4f25-86b4-416085ec8974_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/8fc85d36-15db-4ff4-81d5-36cc0fa0ee98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/9fb088f8-27f6-45af-960e-7e72a5141cfc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/25 - 20K', 'remarks': '**300**VOSA STATES 20K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/500b25e4-0ade-4f53-b149-4e16fd02e343.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117242472, 'registration': 'YP72TVN', 'account': 'KIN032', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '2.5 PHEV ST-Line X Edition 5dr CVT', 'mileage': 20163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-15', 'doors': 5, 'engineSize': 2488, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP72TVN/2025-11-17/image/1f9ffe5c-1b72-4046-920b-fd1f9067e9a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/b53e35c9-b2d8-4964-81da-b088e52bbe43_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/dff8a23f-9015-4aa1-9071-eb1fb96cc499_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/75d0b357-c8aa-4207-91a2-6e006c8d2cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/12bbcaec-c7da-4628-ac9d-245cd12f8812_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/ab169617-305a-4950-8595-af41aa5dafa9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/62730781-054a-4f25-86b4-416085ec8974_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/8fc85d36-15db-4ff4-81d5-36cc0fa0ee98_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP72TVN/2025-11-17/image/9fb088f8-27f6-45af-960e-7e72a5141cfc_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/25 - 20K', 'remarks': '**300**VOSA STATES 20K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/500b25e4-0ade-4f53-b149-4e16fd02e343.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc21cde0-d414-55a9-9930-91a48e9c358a with identifier: 117242472
2025-12-04 19:02:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc21cde0-d414-55a9-9930-91a48e9c358a with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc21cde0-d414-55a9-9930-91a48e9c358a with scrape type 2
2025-12-04 19:02:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc21cde0-d414-55a9-9930-91a48e9c358a, identifier: 117242472
2025-12-04 19:02:04 [astonbarclay.gb] INFO: Found listing with ID: 117087842
2025-12-04 19:02:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117087842%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117087842: 0
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117213726
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117213726%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117213726: 0
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Found listing with ID: 117651285
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651285%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Scrape type for 117651285: 2
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fc10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9ac408dc-0d02-55a9-8e88-b7175b34b18b with identifier: 117208422
2025-12-04 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9ac408dc-0d02-55a9-8e88-b7175b34b18b with identifier: 117208422
2025-12-04 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27175, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117208422', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw v1 58kwh 5dr auto', 'license_plate': 'bj72vtg', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9ac408dc-0d02-55a9-8e88-b7175b34b18b', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 43733} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '9ac408dc-0d02-55a9-8e88-b7175b34b18b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72vtg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117208422',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 27175,
     'odometer_in_km': 43733,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-14',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v1 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 9ac408dc-0d02-55a9-8e88-b7175b34b18b spider: astonbarclay.gb
2025-12-04 19:02:05 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 9ac408dc-0d02-55a9-8e88-b7175b34b18b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'cupra', 'model': 'born electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 27175, 'odometer_reading_unit': 'mi', 'registration_date': '2022-11-14', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117208422', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '150kw v1 58kwh 5dr auto', 'license_plate': 'bj72vtg', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '9ac408dc-0d02-55a9-8e88-b7175b34b18b', 'current_year_diff': 3, 'age_in_months': 36, 'make_model': 'cupra born electric hatchback', 'sanitized_make': 'cupra', 'odometer_in_km': 43733} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 36,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '9ac408dc-0d02-55a9-8e88-b7175b34b18b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'bj72vtg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117208422',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'cupra',
     'make_model': 'cupra born electric hatchback',
     'model': 'born electric hatchback',
     'odometer': 27175,
     'odometer_in_km': 43733,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-11-14',
     'sanitized_make': 'cupra',
     'seller_name': 'kinto',
     'title': 'cupra born electric hatchback 150kw v1 58kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '150kw v1 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '9ac408dc-0d02-55a9-8e88-b7175b34b18b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BJ72VTG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117208422',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'BORN ELECTRIC HATCHBACK',
 'odometer': 27175,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-14',
 'seller_name': 'Kinto',
 'title': 'CUPRA BORN ELECTRIC HATCHBACK 150kW V1 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW V1 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117208422%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Saving data for 117208422: {'auction_closing_time': 1765532700.0, 'created_time': 1764010941.168288, 'last_price_update_time': 1764874925.332657}
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117208422') HTTP/1.1" 204 0
2025-12-04 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with identifier: 117214479
2025-12-04 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with identifier: 117214479
2025-12-04 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 18ec308d-7b66-5a4e-bae9-5674bd4c7926 with identifier: 117214479 to the API
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:05 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 18ec308d-7b66-5a4e-bae9-5674bd4c7926: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:04 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117214479?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 23,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Hybrid Electric',
 'id': '18ec308d-7b66-5a4e-bae9-5674bd4c7926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YR22TLY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117214479',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA ST-LINE PHEV CVT',
 'odometer': 42553,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-09',
 'seller_name': 'Kinto',
 'title': 'FORD KUGA ST-LINE PHEV CVT None',
 'transmission': 'automatic',
 'trim': None,
 'vin': None,
 'year': 2022}
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214479%27 HTTP/1.1" 200 None
2025-12-04 19:02:05 [astonbarclay.gb] INFO: Saving data for 117214479: {'auction_closing_time': 1765532700.0, 'created_time': 1764010945.864699, 'last_price_update_time': 1764874925.698407}
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117214479') HTTP/1.1" 204 0
2025-12-04 19:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc21cde0-d414-55a9-9930-91a48e9c358a with identifier: 117242472
2025-12-04 19:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc21cde0-d414-55a9-9930-91a48e9c358a with identifier: 117242472
2025-12-04 19:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bc21cde0-d414-55a9-9930-91a48e9c358a with identifier: 117242472 to the API
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117242472?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'bc21cde0-d414-55a9-9930-91a48e9c358a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YP72TVN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242472',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 20163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-16',
 'seller_name': 'Kinto',
 'title': 'FORD KUGA ESTATE 2.5 PHEV ST-Line X Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '2.5 PHEV ST-Line X Edition 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242472%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Saving data for 117242472: {'auction_closing_time': 1765532700.0, 'created_time': 1763751864.852511, 'last_price_update_time': 1764874926.051953}
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117242472') HTTP/1.1" 204 0
2025-12-04 19:02:06 [scrapy.extensions.logstats] INFO: Crawled 169 pages (at 79 pages/min), scraped 99 items (at 53 items/min)
2025-12-04 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739947?view=catalogue)
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 116798984
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116798984%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 116798984: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117434122
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117434122%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117434122: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 116806926
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116806926%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 116806926: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117429220
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117429220%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117429220: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117310319
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117310319%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117310319: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117462219
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117462219%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117462219: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 117086159
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117086159%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 117086159: 0
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Found listing with ID: 115302250
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-12-04 19:02:06 [astonbarclay.gb] INFO: Scrape type for 115302250: 2
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5baf150>
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48ebf90>
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fb8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48f31d0>
2025-12-04 19:02:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Ff81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bac950>
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252F83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48f30d0>
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fc3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a4b8d0>
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:02:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676562?view=catalogue)
2025-12-04 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117381413
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117381413%27 HTTP/1.1" 200 None
2025-12-04 19:02:07 [astonbarclay.gb] INFO: Scrape type for 117381413: 0
2025-12-04 19:02:07 [astonbarclay.gb] INFO: Found listing with ID: 117358574
2025-12-04 19:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117358574%27 HTTP/1.1" 200 None
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117358574: 0
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 117547260
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547260%27 HTTP/1.1" 200 None
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Scrape type for 117547260: 0
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 116752111
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116752111%27 HTTP/1.1" 200 None
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Scrape type for 116752111: 0
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Found listing with ID: 114344014
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-12-04 19:02:08 [astonbarclay.gb] INFO: Scrape type for 114344014: 2
2025-12-04 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117570357?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116645477?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117547683?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59fee90>
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f1db10>
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_10.jpg HTTP/1.1" 201 0
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 10 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c61ad0>
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEX71XXS%252F2025-12-04%252Fimage%252Fe87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb6654bd-caba-5ee9-8098-76e29a0edad7
2025-12-04 19:02:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb6654bd-caba-5ee9-8098-76e29a0edad7, skipping ID generation
2025-12-04 19:02:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb6654bd-caba-5ee9-8098-76e29a0edad7 with scrape type 1
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cb6654bd-caba-5ee9-8098-76e29a0edad7 from tracking dictionaries
2025-12-04 19:02:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb6654bd-caba-5ee9-8098-76e29a0edad7 sending to next pipeline
2025-12-04 19:02:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb6654bd-caba-5ee9-8098-76e29a0edad7, identifier: 117739947
2025-12-04 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 116986413
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116986413%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 116986413: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 114700069
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114700069%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 114700069: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 114698400
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114698400%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 114698400: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117402212
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117402212%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117402212: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117538127
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117538127%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117538127: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117080670
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117080670%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117080670: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117537741
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117537741%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117537741: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 115457692
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115457692%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 115457692: 0
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Found listing with ID: 117550785
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-12-04 19:02:09 [astonbarclay.gb] INFO: Scrape type for 117550785: 2
2025-12-04 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb6654bd-caba-5ee9-8098-76e29a0edad7 with identifier: 117739947
2025-12-04 19:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb6654bd-caba-5ee9-8098-76e29a0edad7 with identifier: 117739947
2025-12-04 19:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb6654bd-caba-5ee9-8098-76e29a0edad7 with identifier: 117739947 to the API
2025-12-04 19:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb6654bd-caba-5ee9-8098-76e29a0edad7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EX71XXS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117739947',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 43503,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40768,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/1bdabe97-23cf-488f-bf5c-d86b3b6fb741_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37260,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/d8e44a62-2519-4400-af89-2ba6f12ca1a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33920,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/34f5bee0-0442-4648-a6c8-e703dc806f31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34168,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/db62b4a6-02f4-42c6-98ec-aa332813d340_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54845,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/83fcab98-d4f7-4d3e-9f30-e5b9c31def69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54395,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/aa4d8bde-e27b-4e8d-9321-9038355d2156_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59699,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/8629f40d-9ff1-4e15-804d-386156629207_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47557,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/b8468e7f-9ddb-45a1-b893-a5ccef0d2e8e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41671,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/c3457ecb-abee-4e4f-8e27-f8a6d9e36962_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44662,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/e87683c2-4429-47c9-b8b9-4322a75c96d1_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb6654bd-caba-5ee9-8098-76e29a0edad7/cb6654bd-caba-5ee9-8098-76e29a0edad7_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EX71XXS/2025-12-04/image/ed33a6a2-3e3f-4ad3-afde-b8e2e422df4a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-16',
 'seller_name': 'UKCGR - Premium',
 'title': 'MINI HATCHBACK 1.5 Cooper Sport 3dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper Sport 3dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117739947%27 HTTP/1.1" 200 None
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Saving data for 117739947: {'created_time': 1764874930.344432, 'last_price_update_time': 1764874930.344442, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117739947') HTTP/1.1" 204 0
2025-12-04 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550264?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd69a7390>
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17TCJ%252F2025-12-04%252Fimage%252F07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36
2025-12-04 19:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffc8a11f-9b30-5dd6-9fec-27b1c716da36, skipping ID generation
2025-12-04 19:02:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with scrape type 1
2025-12-04 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ffc8a11f-9b30-5dd6-9fec-27b1c716da36 from tracking dictionaries
2025-12-04 19:02:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffc8a11f-9b30-5dd6-9fec-27b1c716da36 sending to next pipeline
2025-12-04 19:02:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ffc8a11f-9b30-5dd6-9fec-27b1c716da36, identifier: 117676562
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117633313
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633313%27 HTTP/1.1" 200 None
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117633313: 0
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117732998
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117732998%27 HTTP/1.1" 200 None
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117732998: 0
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Found listing with ID: 117190749
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190749%27 HTTP/1.1" 200 None
2025-12-04 19:02:10 [astonbarclay.gb] INFO: Scrape type for 117190749: 1
2025-12-04 19:02:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117580703?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with identifier: 117676562
2025-12-04 19:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with identifier: 117676562
2025-12-04 19:02:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ffc8a11f-9b30-5dd6-9fec-27b1c716da36 with identifier: 117676562 to the API
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ffc8a11f-9b30-5dd6-9fec-27b1c716da36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK17TCJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117676562',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'B-MAX HATCHBACK',
 'odometer': 56476,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36534,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/c0a6d129-ad55-438d-9e45-f852d0672149_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34117,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/19b956a0-0dc1-40d6-8079-522d9bb4338d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36968,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/07f5e3c5-9045-42b5-807f-3c53ca1f7843_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37312,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/2d4a1546-dc43-4549-a022-7df6441ee65c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54090,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/5f48a560-17f1-484a-8196-3973119d66b2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52348,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/f61e70fd-0444-428d-bdd9-db1cac1b42a4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49118,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/a970c266-79c7-4a3c-ad8f-5d03cf68f974_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49529,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/869bb286-d0b3-4543-8403-be4561548d4b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/d62800ec-6f7c-4573-9903-26d07269b099_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffc8a11f-9b30-5dd6-9fec-27b1c716da36/ffc8a11f-9b30-5dd6-9fec-27b1c716da36_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56008,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EK17TCJ/2025-12-04/image/e69d90ba-1e96-4f81-86f9-d135a83e3124_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': 'SMC GROUP',
 'title': 'FORD B-MAX HATCHBACK 1.0 EcoBoost Zetec Navigator 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Zetec Navigator 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676562%27 HTTP/1.1" 200 None
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Saving data for 117676562: {'created_time': 1764874931.271741, 'last_price_update_time': 1764874931.271751, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117676562') HTTP/1.1" 204 0
2025-12-04 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117570357, 'registration': 'LN24CGX', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN24CGX/2025-11-28/image/2a734efb-9ee7-4a2b-ba6e-02231a1a1346_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/17a89acb-eef3-4aed-b602-d07cbdfee954_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/af93f2a5-04cf-45d5-a786-446711d741aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/af5ff7c8-fb09-406f-a266-c4ae394a830e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/f9c9ea5a-e4f5-42f1-a4be-1440fad8f2e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/d172bacb-41b1-45ac-8a23-9d9c4239349f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/3a1ba59f-226f-480d-8c25-83ae0e3656b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/46ba10ac-50a7-4e50-a458-717ca39d68f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/a78aff8d-f6ba-4489-9636-93950effb97d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/980692c8-fa50-4807-8f6d-086d33c8b7f7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24349b65-4fb2-4956-b86a-eebcbc74d841.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117570357, 'registration': 'LN24CGX', 'account': 'MOT070', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '2.0 ePHEV Advance Tech 5dr eCVT', 'mileage': 23955, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1993, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LN24CGX/2025-11-28/image/2a734efb-9ee7-4a2b-ba6e-02231a1a1346_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/17a89acb-eef3-4aed-b602-d07cbdfee954_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/af93f2a5-04cf-45d5-a786-446711d741aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/af5ff7c8-fb09-406f-a266-c4ae394a830e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/f9c9ea5a-e4f5-42f1-a4be-1440fad8f2e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/d172bacb-41b1-45ac-8a23-9d9c4239349f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/3a1ba59f-226f-480d-8c25-83ae0e3656b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/46ba10ac-50a7-4e50-a458-717ca39d68f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/a78aff8d-f6ba-4489-9636-93950effb97d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LN24CGX/2025-11-28/image/980692c8-fa50-4807-8f6d-086d33c8b7f7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 19, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/24349b65-4fb2-4956-b86a-eebcbc74d841.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-12-04 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item faad0b89-828d-5df3-a520-dd47d4db81aa with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item faad0b89-828d-5df3-a520-dd47d4db81aa with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: faad0b89-828d-5df3-a520-dd47d4db81aa, identifier: 117570357
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116645477, 'registration': 'GX24XVC', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 5588, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf45fbb-9497-4082-9d1b-093975299eed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116645477, 'registration': 'GX24XVC', 'account': 'MOT070', 'make': 'SEAT', 'model': 'ATECA ESTATE', 'derivative': '1.5 TSI EVO Xperience 5dr DSG', 'mileage': 5588, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-05-10', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GX24XVC/2025-10-24/image/38c16aeb-54f3-4291-b8b6-c64e77e2f35d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/366f8847-905b-41d1-8e57-c425cc686eae_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/d2440684-130d-4c82-a6ef-bf33f61967b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/1efcf79c-09a2-4522-9491-47613e0fbe8e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/3417620d-da11-4d41-bb90-fb33bb49c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/87c07c83-23a7-4922-a2f1-97cdac34a177_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/b3e2ae2f-eadb-41b3-8b07-20096dac0e75_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/4dfdb481-caaa-46a0-ae78-11b6a2aca2d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/8979fc12-b075-4502-b61b-67030de5fc12_removebg.jpg?w=600', 'https://abimg003.imgix.net/GX24XVC/2025-10-24/image/82924c20-ec0b-4b6d-8018-f5589a51504f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cdf45fbb-9497-4082-9d1b-093975299eed.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-12-04 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 367bcedf-2a69-56d4-9405-4559622746e0 with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 367bcedf-2a69-56d4-9405-4559622746e0 with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 367bcedf-2a69-56d4-9405-4559622746e0, identifier: 116645477
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116504950, 'registration': 'EY74TWG', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 7520, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7427946-8dc1-43c4-bfdb-c7d214882c60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116504950, 'registration': 'EY74TWG', 'account': 'MOT070', 'make': 'MG MOTOR UK', 'model': 'HS HATCHBACK', 'derivative': '1.5 T-GDI Trophy 5dr', 'mileage': 7520, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-09-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9144a101-a7bf-4b77-bca7-e76ea5e14d7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e3332f1f-5a42-4482-ade5-c513e62fea65_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/25ee7630-508a-42e9-8676-a664f6a71909_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/d9d5fc0c-33cc-4a29-a91e-8c01acdee3ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/9a2f2e34-f208-4b1b-8e09-7ff93a4441bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/2ce61bca-c168-4e7e-914c-cb442fb7639e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/3c91e58c-dbe0-4e44-bf74-a63cb4c771d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/e991726b-e49a-4ec7-8f4e-6a26fda10edf_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/b1f65b31-a58a-4f87-a839-939d8feb7f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY74TWG/2025-10-29/image/7dc3fad2-6a8a-4806-8230-965f72e9c60a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 168, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f7427946-8dc1-43c4-bfdb-c7d214882c60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-12-04 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9, identifier: 116504950
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117547683, 'registration': 'LS72NPC', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 20716, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS72NPC/2025-11-29/image/daf2acf1-56ac-4e10-a5e2-6bc1e37fcec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/fe42bb28-4982-4b3b-ac0c-f4a5a5c4d8d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/58341392-657b-4227-8505-0fa00c01db75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/022ad9d3-a8bf-4bed-a61b-fabddcfc59ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/b9c8da52-240d-4258-a61f-21cdf5d1a34f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/b99288cc-aa2d-4c87-85dc-2c865a98a11e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/f833c7dc-3ca3-4674-93ac-12880cc4aa64_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/3a01763a-83a9-476a-8e46-9884870a8712_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/c1d55f3f-8eba-4289-be4a-fd0c07ce7f36_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/9ec0c316-1db3-4068-8c72-ca9e724090ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/c070fad3-1a3a-4a8c-b4cd-343a37aaa38e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f067f7f-d4aa-4a03-8300-bcd542a809bc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117547683, 'registration': 'LS72NPC', 'account': 'MOT070', 'make': 'TOYOTA', 'model': 'COROLLA TOURING SPORT', 'derivative': '1.8 VVT-i Hybrid Icon Tech 5dr CVT', 'mileage': 20716, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-13', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-10-12', 'doors': 5, 'engineSize': 1798, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LS72NPC/2025-11-29/image/daf2acf1-56ac-4e10-a5e2-6bc1e37fcec5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/fe42bb28-4982-4b3b-ac0c-f4a5a5c4d8d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/58341392-657b-4227-8505-0fa00c01db75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/022ad9d3-a8bf-4bed-a61b-fabddcfc59ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/b9c8da52-240d-4258-a61f-21cdf5d1a34f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/b99288cc-aa2d-4c87-85dc-2c865a98a11e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/f833c7dc-3ca3-4674-93ac-12880cc4aa64_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/3a01763a-83a9-476a-8e46-9884870a8712_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/c1d55f3f-8eba-4289-be4a-fd0c07ce7f36_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/9ec0c316-1db3-4068-8c72-ca9e724090ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/LS72NPC/2025-11-29/image/c070fad3-1a3a-4a8c-b4cd-343a37aaa38e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6f067f7f-d4aa-4a03-8300-bcd542a809bc.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-12-04 19:02:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee275063-9db5-5de0-b650-3b0ea696ee7b with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee275063-9db5-5de0-b650-3b0ea696ee7b with scrape type 2
2025-12-04 19:02:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ee275063-9db5-5de0-b650-3b0ea696ee7b, identifier: 117547683
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f13610>
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252F97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a78c10>
2025-12-04 19:02:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fc10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117734051?view=catalogue)
2025-12-04 19:02:12 [astonbarclay.gb] INFO: Found listing with ID: 116265155
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-12-04 19:02:12 [astonbarclay.gb] INFO: Scrape type for 116265155: 2
2025-12-04 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-12-04 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357
2025-12-04 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: faad0b89-828d-5df3-a520-dd47d4db81aa with identifier: 117570357 to the API
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27faad0b89-828d-5df3-a520-dd47d4db81aa%27 HTTP/1.1" 200 None
2025-12-04 19:02:12 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id faad0b89-828d-5df3-a520-dd47d4db81aa: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:11 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117570357?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 19,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'faad0b89-828d-5df3-a520-dd47d4db81aa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LN24CGX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117570357',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 23955,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-30',
 'seller_name': 'Motability Operations',
 'title': 'HONDA CR-V ESTATE 2.0 ePHEV Advance Tech 5dr eCVT',
 'transmission': 'automatic',
 'trim': '2.0 ePHEV Advance Tech 5dr eCVT',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117570357%27 HTTP/1.1" 200 None
2025-12-04 19:02:12 [astonbarclay.gb] INFO: Saving data for 117570357: {'auction_closing_time': 1765792800.0, 'created_time': 1764270321.815809, 'last_price_update_time': 1764874932.500558}
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117570357') HTTP/1.1" 204 0
2025-12-04 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-12-04 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477
2025-12-04 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 367bcedf-2a69-56d4-9405-4559622746e0 with identifier: 116645477 to the API
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116645477?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '367bcedf-2a69-56d4-9405-4559622746e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GX24XVC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116645477',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SEAT',
 'model': 'ATECA ESTATE',
 'odometer': 5588,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-05-10',
 'seller_name': 'Motability Operations',
 'title': 'SEAT ATECA ESTATE 1.5 TSI EVO Xperience 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 TSI EVO Xperience 5dr DSG',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116645477%27 HTTP/1.1" 200 None
2025-12-04 19:02:12 [astonbarclay.gb] INFO: Saving data for 116645477: {'auction_closing_time': 1765792800.0, 'created_time': 1764270333.325648, 'last_price_update_time': 1764874932.80678}
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116645477') HTTP/1.1" 204 0
2025-12-04 19:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-12-04 19:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950
2025-12-04 19:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 46bdee26-3d6d-54e7-b2d0-dba8628bd6d9 with identifier: 116504950 to the API
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116504950?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 168,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '46bdee26-3d6d-54e7-b2d0-dba8628bd6d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY74TWG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116504950',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'HS HATCHBACK',
 'odometer': 7520,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-09-30',
 'seller_name': 'Motability Operations',
 'title': 'MG MOTOR UK HS HATCHBACK 1.5 T-GDI Trophy 5dr',
 'transmission': 'manual',
 'trim': '1.5 T-GDI Trophy 5dr',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116504950%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Saving data for 116504950: {'auction_closing_time': 1765792800.0, 'created_time': 1764270376.750561, 'last_price_update_time': 1764874933.097233}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116504950') HTTP/1.1" 204 0
2025-12-04 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-12-04 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683
2025-12-04 19:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ee275063-9db5-5de0-b650-3b0ea696ee7b with identifier: 117547683 to the API
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ee275063-9db5-5de0-b650-3b0ea696ee7b%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ee275063-9db5-5de0-b650-3b0ea696ee7b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117547683?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': 'ee275063-9db5-5de0-b650-3b0ea696ee7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS72NPC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117547683',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TOYOTA',
 'model': 'COROLLA TOURING SPORT',
 'odometer': 20716,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-13',
 'seller_name': 'Motability Operations',
 'title': 'TOYOTA COROLLA TOURING SPORT 1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.8 VVT-i Hybrid Icon Tech 5dr CVT',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117547683%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Saving data for 117547683: {'auction_closing_time': 1765792800.0, 'created_time': 1764270323.395868, 'last_price_update_time': 1764874933.389274}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117547683') HTTP/1.1" 204 0
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550264, 'registration': 'LM25DFA', 'account': 'MOT070', 'make': 'CUPRA', 'model': 'FORMENTOR ESTATE', 'derivative': '1.5 eTSI 150 V1 5dr DSG', 'mileage': 1393, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM25DFA/2025-11-28/image/efb7cdbd-b786-4884-be7d-35601d777214_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/0855174b-8b44-4b42-9341-0d363b577f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/64d87800-8a4b-47c3-a9dd-d9d3c1f5ce88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/a5a26891-234a-49c8-b267-8720acbdfd5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/23f914e2-d7f8-48b3-9192-bb9703676616_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/0181cfc8-f1f3-4f0d-a8a9-9fe93092c513_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/df492004-023e-43cb-b01f-4ece2d75acc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/c2f19138-597c-4926-846e-b928276a6a66_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/aa98d1c8-c185-41c9-9bdf-f2f0a111a105_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/df5e4770-53bf-42ff-a484-367012bb0a87_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8a8e201-467a-48f1-9264-628001fd09ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550264, 'registration': 'LM25DFA', 'account': 'MOT070', 'make': 'CUPRA', 'model': 'FORMENTOR ESTATE', 'derivative': '1.5 eTSI 150 V1 5dr DSG', 'mileage': 1393, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2025-06-27', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM25DFA/2025-11-28/image/efb7cdbd-b786-4884-be7d-35601d777214_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/0855174b-8b44-4b42-9341-0d363b577f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/64d87800-8a4b-47c3-a9dd-d9d3c1f5ce88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/a5a26891-234a-49c8-b267-8720acbdfd5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/23f914e2-d7f8-48b3-9192-bb9703676616_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/0181cfc8-f1f3-4f0d-a8a9-9fe93092c513_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/df492004-023e-43cb-b01f-4ece2d75acc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/c2f19138-597c-4926-846e-b928276a6a66_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/aa98d1c8-c185-41c9-9bdf-f2f0a111a105_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM25DFA/2025-11-28/image/df5e4770-53bf-42ff-a484-367012bb0a87_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b8a8e201-467a-48f1-9264-628001fd09ad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-12-04 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6f4874c-2c33-5c1b-b077-9222afab4ab8 with scrape type 2
2025-12-04 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6f4874c-2c33-5c1b-b077-9222afab4ab8 with scrape type 2
2025-12-04 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6f4874c-2c33-5c1b-b077-9222afab4ab8, identifier: 117550264
2025-12-04 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-12-04 19:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264
2025-12-04 19:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d6f4874c-2c33-5c1b-b077-9222afab4ab8 with identifier: 117550264 to the API
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d6f4874c-2c33-5c1b-b077-9222afab4ab8%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d6f4874c-2c33-5c1b-b077-9222afab4ab8: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550264?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd6f4874c-2c33-5c1b-b077-9222afab4ab8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM25DFA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550264',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CUPRA',
 'model': 'FORMENTOR ESTATE',
 'odometer': 1393,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-27',
 'seller_name': 'Motability Operations',
 'title': 'CUPRA FORMENTOR ESTATE 1.5 eTSI 150 V1 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 eTSI 150 V1 5dr DSG',
 'vin': None,
 'year': 2025}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550264%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Saving data for 117550264: {'auction_closing_time': 1765792800.0, 'created_time': 1764270331.767026, 'last_price_update_time': 1764874933.82311}
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550264') HTTP/1.1" 204 0
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Found listing with ID: 117106625
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Scrape type for 117106625: 2
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117580703, 'registration': 'GN21SKD', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] Inscription Pro 5dr Geartronic', 'mileage': 81092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GN21SKD/2025-11-28/image/145ff4cd-26fb-4c9a-b000-5edee5a831d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/9cc76760-ea1c-4724-bbfe-18e77266b553_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/b5dc6704-76ff-41a5-a913-822b441a1677_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/aa92e3b2-4118-4b1c-817e-8f775fd16660_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/f0c1c424-fe07-4b82-af8f-fadeee069856_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/0d1b21c9-c79d-4a21-9221-a62c011caeda_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/28d94c9d-5cb4-4d68-96b4-f1615ced2cd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/447a8917-db9d-49bf-b79e-ac36ef348a50_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/db345fc1-50d1-4784-a96d-c0879afa23b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 54K- 74K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2de87945-dd7d-4ab3-93dc-36f6411ce4a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117580703, 'registration': 'GN21SKD', 'account': 'MOT070', 'make': 'VOLVO', 'model': 'XC40 ESTATE', 'derivative': '1.5 T3 [163] Inscription Pro 5dr Geartronic', 'mileage': 81092, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-03-08', 'fuel': 'Petrol', 'motExpiry': '2026-04-09', 'doors': 5, 'engineSize': 1477, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GN21SKD/2025-11-28/image/145ff4cd-26fb-4c9a-b000-5edee5a831d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/9cc76760-ea1c-4724-bbfe-18e77266b553_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/b5dc6704-76ff-41a5-a913-822b441a1677_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/aa92e3b2-4118-4b1c-817e-8f775fd16660_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/f0c1c424-fe07-4b82-af8f-fadeee069856_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/0d1b21c9-c79d-4a21-9221-a62c011caeda_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/28d94c9d-5cb4-4d68-96b4-f1615ced2cd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/447a8917-db9d-49bf-b79e-ac36ef348a50_removebg.jpg?w=600', 'https://abimg003.imgix.net/GN21SKD/2025-11-28/image/db345fc1-50d1-4784-a96d-c0879afa23b5_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 54K- 74K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2de87945-dd7d-4ab3-93dc-36f6411ce4a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with identifier: 117580703
2025-12-04 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with scrape type 2
2025-12-04 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with scrape type 2
2025-12-04 19:02:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 13caf0cc-fe72-54d3-a4dd-fade2af51c14, identifier: 117580703
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116557093, 'registration': 'GL74UKJ', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 8612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN  - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b69ac6ab-2958-489d-aa02-4d509789b75b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116557093, 'registration': 'GL74UKJ', 'account': 'MOT070', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic', 'mileage': 8612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-12-18', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/d9a039ac-0d28-4c1d-9424-af0fd9b96175_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/8da6f2a7-f738-4507-bcd9-78d0f54bb5fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/f7eba520-6088-48d5-b337-2ba6a4b70663_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/2498a6cc-9d78-4adf-b1d6-2ef811b57412_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/781467e7-2fc5-413e-8054-f822fe21b3fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/aeb689ab-ca46-4472-abfa-b98aed6bac41_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/bb44fb16-a01f-4896-8e3b-1c1d108815d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/c27f71ef-da61-415d-981f-574884694df2_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/cf0f00cf-222d-4607-9375-3dce9186d74c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GL74UKJ/2025-10-29/image/3ef0d339-304c-477b-beb7-2d51564c209e_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN  - V5 Document Reference Number Available Upon Purchase"', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b69ac6ab-2958-489d-aa02-4d509789b75b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-12-04 19:02:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with scrape type 2
2025-12-04 19:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with scrape type 2
2025-12-04 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2aa95ee2-75cc-5bf0-aa48-be00bab61433, identifier: 116557093
2025-12-04 19:02:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116500039, 'registration': 'EF22XOZ', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD', 'mileage': 19583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 15K', 'remarks': 'VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e399081-4093-41dc-ac03-f035553bd921.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116500039, 'registration': 'EF22XOZ', 'account': 'MOT070', 'make': 'FORD', 'model': 'KUGA DIESEL ESTATE', 'derivative': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD', 'mileage': 19583, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-23', 'fuel': 'Diesel', 'motExpiry': '2026-07-23', 'doors': 5, 'engineSize': 1995, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/64618cf3-2feb-441a-87e4-03c8ffb0f6fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/3c0495da-9fe6-4d46-917c-a91ff95947e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9a59fb19-d5c1-4b8d-9f14-3fa6a9fd8c03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/778a5a9c-c868-434c-bcb2-4cc11c99ff26_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/9c110450-a460-4827-977f-b844cb7bf782_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/192349a9-6bf7-473f-b7f6-f06296290e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/34964106-4b2a-4104-bbe7-66fd1dd3f36a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/e4b0b7a8-8f81-445b-87d5-6c9297935f3f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EF22XOZ/2025-10-22/image/95b9ba2d-2c02-4c7b-b5b6-cdf598fca758_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/24 15K', 'remarks': 'VOSA STATES, 19K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': True, 'v5details': 'Here', 'co2': 150, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1e399081-4093-41dc-ac03-f035553bd921.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-12-04 19:02:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95151d0a-5a69-529c-babd-8bdf3c4858ea with scrape type 2
2025-12-04 19:02:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95151d0a-5a69-529c-babd-8bdf3c4858ea with scrape type 2
2025-12-04 19:02:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 95151d0a-5a69-529c-babd-8bdf3c4858ea, identifier: 116500039
2025-12-04 19:02:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with identifier: 117580703
2025-12-04 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with identifier: 117580703
2025-12-04 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 13caf0cc-fe72-54d3-a4dd-fade2af51c14 with identifier: 117580703 to the API
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2713caf0cc-fe72-54d3-a4dd-fade2af51c14%27 HTTP/1.1" 200 None
2025-12-04 19:02:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 13caf0cc-fe72-54d3-a4dd-fade2af51c14: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117580703?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '13caf0cc-fe72-54d3-a4dd-fade2af51c14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GN21SKD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117580703',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLVO',
 'model': 'XC40 ESTATE',
 'odometer': 81092,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-08',
 'seller_name': 'Motability Operations',
 'title': 'VOLVO XC40 ESTATE 1.5 T3 [163] Inscription Pro 5dr Geartronic',
 'transmission': 'automatic',
 'trim': '1.5 T3 [163] Inscription Pro 5dr Geartronic',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117580703%27 HTTP/1.1" 200 None
2025-12-04 19:02:14 [astonbarclay.gb] INFO: Saving data for 117580703: {'auction_closing_time': 1765792800.0, 'created_time': 1764320468.805948, 'last_price_update_time': 1764874934.420776}
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117580703') HTTP/1.1" 204 0
2025-12-04 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-12-04 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093
2025-12-04 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2aa95ee2-75cc-5bf0-aa48-be00bab61433 with identifier: 116557093 to the API
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116557093?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2aa95ee2-75cc-5bf0-aa48-be00bab61433',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GL74UKJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116557093',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 8612,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-12-18',
 'seller_name': 'Motability Operations',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr '
          'Xtronic',
 'transmission': 'automatic',
 'trim': '1.3 DiG-T MH 158 N-Connecta [Glass Rf] 5dr Xtronic',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116557093%27 HTTP/1.1" 200 None
2025-12-04 19:02:14 [astonbarclay.gb] INFO: Saving data for 116557093: {'auction_closing_time': 1765792800.0, 'created_time': 1764270377.49359, 'last_price_update_time': 1764874934.698642}
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116557093') HTTP/1.1" 204 0
2025-12-04 19:02:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-12-04 19:02:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039
2025-12-04 19:02:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 95151d0a-5a69-529c-babd-8bdf3c4858ea with identifier: 116500039 to the API
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116500039?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 150,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '95151d0a-5a69-529c-babd-8bdf3c4858ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EF22XOZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116500039',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'KUGA DIESEL ESTATE',
 'odometer': 19583,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-23',
 'seller_name': 'Motability Operations',
 'title': 'FORD KUGA DIESEL ESTATE 2.0 EcoBlue 190 Titanium Edition 5dr Auto '
          'AWD',
 'transmission': 'automatic',
 'trim': '2.0 EcoBlue 190 Titanium Edition 5dr Auto AWD',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116500039%27 HTTP/1.1" 200 None
2025-12-04 19:02:14 [astonbarclay.gb] INFO: Saving data for 116500039: {'auction_closing_time': 1765792800.0, 'created_time': 1764270375.740209, 'last_price_update_time': 1764874934.994795}
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116500039') HTTP/1.1" 204 0
2025-12-04 19:02:15 [astonbarclay.gb] INFO: Found listing with ID: 116269848
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-12-04 19:02:15 [astonbarclay.gb] INFO: Scrape type for 116269848: 2
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd83f6e90>
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLY21FYW%252F2025-12-03%252Fimage%252Fe42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d573f19d-e8b5-5c74-997b-81688dc23e79
2025-12-04 19:02:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d573f19d-e8b5-5c74-997b-81688dc23e79, skipping ID generation
2025-12-04 19:02:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d573f19d-e8b5-5c74-997b-81688dc23e79 with scrape type 1
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d573f19d-e8b5-5c74-997b-81688dc23e79 from tracking dictionaries
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d573f19d-e8b5-5c74-997b-81688dc23e79 sending to next pipeline
2025-12-04 19:02:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d573f19d-e8b5-5c74-997b-81688dc23e79, identifier: 117734051
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bfea90>
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c7fd50>
2025-12-04 19:02:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fdb84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117771342?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117642361?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117651285?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117546359?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d573f19d-e8b5-5c74-997b-81688dc23e79 with identifier: 117734051
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=WHITE%2FBLACK HTTP/1.1" 200 None
2025-12-04 19:02:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:02:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d573f19d-e8b5-5c74-997b-81688dc23e79 with identifier: 117734051
2025-12-04 19:02:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d573f19d-e8b5-5c74-997b-81688dc23e79 with identifier: 117734051 to the API
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd573f19d-e8b5-5c74-997b-81688dc23e79',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LY21FYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117734051',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': '500X HATCHBACK',
 'odometer': 17715,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32331,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/bdf47719-737d-4b76-b798-ea5228610731_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33190,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e48d40be-2f50-4445-b9af-502f503f881d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28102,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/1cdf54e5-e3bc-47a0-8c95-e8b34620d658_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26236,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e4d1a8dd-b222-4348-948f-072b68dd0f31_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55381,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/f81f2c10-aa77-46b0-b6ef-e4aec1e57c29_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38960,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/51fa1d83-c7e4-402b-8b32-b902bf0d635b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42747,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/e42255ab-09fb-472b-889d-4b4e98eb1997_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42539,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/14873b3c-5801-4529-b9e1-bd974d61f1b6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33738,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/97f91240-9395-42f7-8575-b178eb4471e2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d573f19d-e8b5-5c74-997b-81688dc23e79/d573f19d-e8b5-5c74-997b-81688dc23e79_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41855,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LY21FYW/2025-12-03/image/c10f1710-5234-44c7-9ae7-f2e5d57d26a5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'UKCGR - Premium',
 'title': 'FIAT 500X HATCHBACK 1.3 Sport 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.3 Sport 5dr DCT',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117734051%27 HTTP/1.1" 200 None
2025-12-04 19:02:16 [astonbarclay.gb] INFO: Saving data for 117734051: {'created_time': 1764874936.616769, 'last_price_update_time': 1764874936.616779, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117734051') HTTP/1.1" 204 0
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bb7b10>
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115302250?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117771342, 'registration': 'DU72GXJ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '150kW Life Pro Performance 58kWh 5dr Auto', 'mileage': 17819, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-27', 'fuel': 'Electric', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24 11K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 16K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117771342, 'registration': 'DU72GXJ', 'account': 'MOT070', 'make': 'VOLKSWAGEN', 'model': 'ID.3 HATCHBACK', 'derivative': '150kW Life Pro Performance 58kWh 5dr Auto', 'mileage': 17819, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-10-27', 'fuel': 'Electric', 'motExpiry': '2026-08-20', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 10/24 11K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 16K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61b009bd-e01b-57dd-90cb-f330c062d113 with identifier: 117771342
2025-12-04 19:02:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61b009bd-e01b-57dd-90cb-f330c062d113 with scrape type 1
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 61b009bd-e01b-57dd-90cb-f330c062d113
2025-12-04 19:02:16 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 61b009bd-e01b-57dd-90cb-f330c062d113
2025-12-04 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 61b009bd-e01b-57dd-90cb-f330c062d113, identifier: 117771342
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117642361, 'registration': 'YP24HJU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 17998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YP24HJU/2025-12-02/image/063a0855-b335-4726-a3f5-859bd750170d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/921aecf5-f0a2-4094-903e-a8701387ee7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/3c16da1e-6149-4432-88f9-dffd4195ad5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/953831c6-1285-4ebd-8590-7012d80f5c6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/e7907add-b06a-413c-b6a1-eed4e5590eee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/b19051f5-1d1c-44e9-aa78-65cc753920ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/5deb7b11-10b2-4929-ba01-703dad4fed35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/fb7c84e3-28e7-43a0-a9f6-1f78a09fe525_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/01f6811c-7b35-48cd-9d76-9fab7b11a4c7_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60778492-ea94-4df7-a446-db023ba6976b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117642361, 'registration': 'YP24HJU', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CROSSLAND HATCHBACK', 'derivative': '1.2 Turbo [130] Ultimate 5dr Auto', 'mileage': 17998, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-04-23', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YP24HJU/2025-12-02/image/063a0855-b335-4726-a3f5-859bd750170d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/921aecf5-f0a2-4094-903e-a8701387ee7f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/3c16da1e-6149-4432-88f9-dffd4195ad5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/953831c6-1285-4ebd-8590-7012d80f5c6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/e7907add-b06a-413c-b6a1-eed4e5590eee_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/b19051f5-1d1c-44e9-aa78-65cc753920ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/5deb7b11-10b2-4929-ba01-703dad4fed35_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/fb7c84e3-28e7-43a0-a9f6-1f78a09fe525_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP24HJU/2025-12-02/image/01f6811c-7b35-48cd-9d76-9fab7b11a4c7_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/25 9k', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 144, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60778492-ea94-4df7-a446-db023ba6976b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76b21134-7293-5d2f-9cf8-7429ba5997c9 with identifier: 117642361
2025-12-04 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76b21134-7293-5d2f-9cf8-7429ba5997c9 with scrape type 2
2025-12-04 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76b21134-7293-5d2f-9cf8-7429ba5997c9 with scrape type 2
2025-12-04 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 76b21134-7293-5d2f-9cf8-7429ba5997c9, identifier: 117642361
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117651285, 'registration': 'AO74VUE', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-3008 ELECTRIC ESTATE', 'derivative': '157kW GT 73kWh 5dr Auto', 'mileage': 1041, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO74VUE/2025-12-02/image/879127a4-a751-43fa-9c99-fb6fb4654c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/80e0d411-c9ef-480e-876f-b91394b2c51e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/806c824e-8625-41dc-8bb0-a7d8b5d35c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/7e9116d1-4603-4817-a105-b5663b190528_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/4a514ffb-3d75-4e01-9e66-7aa0bfa0d2db_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/a3e9677a-8af7-49c8-ba4c-9f69cb68cd94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/f7462a62-0d68-4193-8ec1-1bab355c2524_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/c5b224f7-a10f-493a-ac2d-6947366608c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/7f66e02d-87bf-4d0c-8a1f-c23e13b17aa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/64b59428-a232-4edf-8814-287d26a4cde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/2c3c653d-9f2e-4f85-aca8-7771c109cfeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/b9c511bc-ca69-4576-aa99-4e7d911dd338_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01cd34f2-4bbf-4337-bb64-5eba5568554b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117651285, 'registration': 'AO74VUE', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': 'E-3008 ELECTRIC ESTATE', 'derivative': '157kW GT 73kWh 5dr Auto', 'mileage': 1041, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-11-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/AO74VUE/2025-12-02/image/879127a4-a751-43fa-9c99-fb6fb4654c25_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/80e0d411-c9ef-480e-876f-b91394b2c51e_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/806c824e-8625-41dc-8bb0-a7d8b5d35c27_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/7e9116d1-4603-4817-a105-b5663b190528_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/4a514ffb-3d75-4e01-9e66-7aa0bfa0d2db_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/a3e9677a-8af7-49c8-ba4c-9f69cb68cd94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/f7462a62-0d68-4193-8ec1-1bab355c2524_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/c5b224f7-a10f-493a-ac2d-6947366608c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/7f66e02d-87bf-4d0c-8a1f-c23e13b17aa7_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/64b59428-a232-4edf-8814-287d26a4cde1_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/2c3c653d-9f2e-4f85-aca8-7771c109cfeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/AO74VUE/2025-12-02/image/b9c511bc-ca69-4576-aa99-4e7d911dd338_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01cd34f2-4bbf-4337-bb64-5eba5568554b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02a15f8-7dff-58d4-93e9-a6778daf140b with identifier: 117651285
2025-12-04 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02a15f8-7dff-58d4-93e9-a6778daf140b with scrape type 2
2025-12-04 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02a15f8-7dff-58d4-93e9-a6778daf140b with scrape type 2
2025-12-04 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c02a15f8-7dff-58d4-93e9-a6778daf140b, identifier: 117651285
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117546359, 'registration': 'NL24XCO', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH full hybrid 145 Esprit Alpine 5dr Auto', 'mileage': 20886, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-07', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cab244a-659b-46ff-9a0f-90de58d1536e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117546359, 'registration': 'NL24XCO', 'account': 'MOT070', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.6 E-TECH full hybrid 145 Esprit Alpine 5dr Auto', 'mileage': 20886, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2024-03-07', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9cab244a-659b-46ff-9a0f-90de58d1536e.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055 with identifier: 117546359
2025-12-04 19:02:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055 with scrape type 1
2025-12-04 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055
2025-12-04 19:02:17 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055
2025-12-04 19:02:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055, identifier: 117546359
2025-12-04 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 61b009bd-e01b-57dd-90cb-f330c062d113 with identifier: 117771342
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 61b009bd-e01b-57dd-90cb-f330c062d113 with identifier: 117771342
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 150kw life pro performance 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17819, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-27', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117771342', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw life pro performance 58kwh 5dr auto', 'license_plate': 'du72gxj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '61b009bd-e01b-57dd-90cb-f330c062d113', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 28676} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '61b009bd-e01b-57dd-90cb-f330c062d113',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'du72gxj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117771342',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 17819,
     'odometer_in_km': 28676,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-27',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.3 hatchback 150kw life pro performance 58kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw life pro performance 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 61b009bd-e01b-57dd-90cb-f330c062d113 spider: astonbarclay.gb
2025-12-04 19:02:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 61b009bd-e01b-57dd-90cb-f330c062d113 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'silver', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'volkswagen id.3 hatchback 150kw life pro performance 58kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'id.3 hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 17819, 'odometer_reading_unit': 'mi', 'registration_date': '2022-10-27', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117771342', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '150kw life pro performance 58kwh 5dr auto', 'license_plate': 'du72gxj', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '61b009bd-e01b-57dd-90cb-f330c062d113', 'current_year_diff': 3, 'age_in_months': 37, 'make_model': 'volkswagen id.3 hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 28676} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 37,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'silver',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': '61b009bd-e01b-57dd-90cb-f330c062d113',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'du72gxj',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117771342',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen id.3 hatchback',
     'model': 'id.3 hatchback',
     'odometer': 17819,
     'odometer_in_km': 28676,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-10-27',
     'sanitized_make': 'volkswagen',
     'seller_name': 'motability operations',
     'title': 'volkswagen id.3 hatchback 150kw life pro performance 58kwh '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '150kw life pro performance 58kwh 5dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '61b009bd-e01b-57dd-90cb-f330c062d113',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DU72GXJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117771342',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'ID.3 HATCHBACK',
 'odometer': 17819,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': 'Motability Operations',
 'title': 'VOLKSWAGEN ID.3 HATCHBACK 150kW Life Pro Performance 58kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '150kW Life Pro Performance 58kWh 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117771342%27 HTTP/1.1" 200 None
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Saving data for 117771342: {'created_time': 1764874937.531595, 'last_price_update_time': 1764874937.531604, 'auction_closing_time': 1765792800.0}
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117771342') HTTP/1.1" 204 0
2025-12-04 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 76b21134-7293-5d2f-9cf8-7429ba5997c9 with identifier: 117642361
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 76b21134-7293-5d2f-9cf8-7429ba5997c9 with identifier: 117642361
2025-12-04 19:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 76b21134-7293-5d2f-9cf8-7429ba5997c9 with identifier: 117642361 to the API
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2776b21134-7293-5d2f-9cf8-7429ba5997c9%27 HTTP/1.1" 200 None
2025-12-04 19:02:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 76b21134-7293-5d2f-9cf8-7429ba5997c9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117642361?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 144,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '76b21134-7293-5d2f-9cf8-7429ba5997c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP24HJU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117642361',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND HATCHBACK',
 'odometer': 17998,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-04-23',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CROSSLAND HATCHBACK 1.2 Turbo [130] Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo [130] Ultimate 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117642361%27 HTTP/1.1" 200 None
2025-12-04 19:02:17 [astonbarclay.gb] INFO: Saving data for 117642361: {'auction_closing_time': 1765792800.0, 'created_time': 1764666054.556006, 'last_price_update_time': 1764874937.867004}
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117642361') HTTP/1.1" 204 0
2025-12-04 19:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c02a15f8-7dff-58d4-93e9-a6778daf140b with identifier: 117651285
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c02a15f8-7dff-58d4-93e9-a6778daf140b with identifier: 117651285
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-3008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1041, 'odometer_reading_unit': 'mi', 'registration_date': '2024-11-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651285', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '157kw gt 73kwh 5dr auto', 'license_plate': 'ao74vue', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'c02a15f8-7dff-58d4-93e9-a6778daf140b', 'current_year_diff': 1, 'age_in_months': 12, 'make_model': 'peugeot e-3008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 1675} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 12,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'c02a15f8-7dff-58d4-93e9-a6778daf140b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ao74vue',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651285',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'peugeot',
     'make_model': 'peugeot e-3008 electric estate',
     'model': 'e-3008 electric estate',
     'odometer': 1041,
     'odometer_in_km': 1675,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-19',
     'sanitized_make': 'peugeot',
     'seller_name': 'motability operations',
     'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '157kw gt 73kwh 5dr auto',
     'vin': None,
     'year': 2024}
2025-12-04 19:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: c02a15f8-7dff-58d4-93e9-a6778daf140b spider: astonbarclay.gb
2025-12-04 19:02:18 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c02a15f8-7dff-58d4-93e9-a6778daf140b due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'blue', 'original_photo_count': 0, 'seller_name': 'motability operations', 'price_includes_vat': False, 'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'peugeot', 'model': 'e-3008 electric estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 1041, 'odometer_reading_unit': 'mi', 'registration_date': '2024-11-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651285', 'expiration_date': '2025-12-15t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '157kw gt 73kwh 5dr auto', 'license_plate': 'ao74vue', 'year': 2024, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'c02a15f8-7dff-58d4-93e9-a6778daf140b', 'current_year_diff': 1, 'age_in_months': 12, 'make_model': 'peugeot e-3008 electric estate', 'sanitized_make': 'peugeot', 'odometer_in_km': 1675} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 12,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'blue',
     'currency': 'gbp',
     'current_year_diff': 1,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-15t10:00:00z',
     'fuel_type': 'electric',
     'id': 'c02a15f8-7dff-58d4-93e9-a6778daf140b',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ao74vue',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651285',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'peugeot',
     'make_model': 'peugeot e-3008 electric estate',
     'model': 'e-3008 electric estate',
     'odometer': 1041,
     'odometer_in_km': 1675,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2024-11-19',
     'sanitized_make': 'peugeot',
     'seller_name': 'motability operations',
     'title': 'peugeot e-3008 electric estate 157kw gt 73kwh 5dr auto',
     'transmission': 'automatic',
     'trim': '157kw gt 73kwh 5dr auto',
     'vin': None,
     'year': 2024}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Electric',
 'id': 'c02a15f8-7dff-58d4-93e9-a6778daf140b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AO74VUE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117651285',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': 'E-3008 ELECTRIC ESTATE',
 'odometer': 1041,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-11-19',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT E-3008 ELECTRIC ESTATE 157kW GT 73kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '157kW GT 73kWh 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117651285%27 HTTP/1.1" 200 None
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Saving data for 117651285: {'auction_closing_time': 1765792800.0, 'created_time': 1764666055.43838, 'last_price_update_time': 1764874938.088733}
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117651285') HTTP/1.1" 204 0
2025-12-04 19:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055 with identifier: 117546359
2025-12-04 19:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055 with identifier: 117546359
2025-12-04 19:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055 with identifier: 117546359 to the API
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2710c808ee-1dd6-57e7-a54c-a7b3b7ab5055%27 HTTP/1.1" 200 None
2025-12-04 19:02:18 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 10c808ee-1dd6-57e7-a54c-a7b3b7ab5055: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:17 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117546359?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '10c808ee-1dd6-57e7-a54c-a7b3b7ab5055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL24XCO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117546359',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 20886,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-03-07',
 'seller_name': 'Motability Operations',
 'title': 'RENAULT CLIO HATCHBACK 1.6 E-TECH full hybrid 145 Esprit Alpine 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '1.6 E-TECH full hybrid 145 Esprit Alpine 5dr Auto',
 'vin': None,
 'year': 2024}
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117546359%27 HTTP/1.1" 200 None
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Saving data for 117546359: {'created_time': 1764874938.379718, 'last_price_update_time': 1764874938.379729, 'auction_closing_time': 1765792800.0}
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117546359') HTTP/1.1" 204 0
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f06190>
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117767677, 'registration': 'LV72ULD', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 15293, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-05', 'fuel': 'Petrol', 'motExpiry': '2026-11-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 4K - 11/24 9K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 14K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bd03bd1-2b37-4aed-9e59-9438f239fb7f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117767677, 'registration': 'LV72ULD', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'MOKKA HATCHBACK', 'derivative': '1.2 Turbo Ultimate 5dr Auto', 'mileage': 15293, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-11-05', 'fuel': 'Petrol', 'motExpiry': '2026-11-04', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/23 4K - 11/24 9K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES, 14K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2bd03bd1-2b37-4aed-9e59-9438f239fb7f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 563606a8-a7b4-5f11-a24b-0099219bc718 with identifier: 117767677
2025-12-04 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563606a8-a7b4-5f11-a24b-0099219bc718 with scrape type 1
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 114344014, 'registration': 'LO22KXH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT Premium 5dr EAT8', 'mileage': 27677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/23- 11K, 06/24- 17K, 04/25- 25K', 'remarks': 'VOSA STATES 25K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0b32466-4ae0-40b1-9dcd-8105f76fcb18.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 114344014, 'registration': 'LO22KXH', 'account': 'MOT070', 'make': 'PEUGEOT', 'model': '3008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi GT Premium 5dr EAT8', 'mileage': 27677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-04-22', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LO22KXH/2025-11-06/image/c26c4c12-0638-430c-b462-454ee42353dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/78caa056-81cc-408a-b08f-020b269aba38_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/b474adf6-4555-4a72-950f-01f16c49b0b2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/276a39a8-3d91-44dc-9d07-878e0e2ea172_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/2c69fdc4-fe77-44d3-8746-ea6f3c6e24d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/1ba79598-93f7-4c38-a7b8-77669d21a216_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/98811447-7a07-4a9f-9a98-f0f50ad36bfb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/6865ef17-eabf-4ef6-9def-b6f84a178e9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LO22KXH/2025-11-06/image/9ee0a47c-1b9a-43a8-9643-c7652d70fa69_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 06/23- 11K, 06/24- 17K, 04/25- 25K', 'remarks': 'VOSA STATES 25K', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c0b32466-4ae0-40b1-9dcd-8105f76fcb18.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-12-04 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with scrape type 2
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with scrape type 2
2025-12-04 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf, identifier: 114344014
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 115302250, 'registration': 'OW25UYT', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA ULTIMATE TURBO', 'derivative': None, 'mileage': 1674, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2d9add00-69ec-431a-b59f-6646804901af_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2598fee5-a9bb-4d48-882c-66fc9fcd2c47_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/78e63196-0324-4ea7-86df-22e1b6a3c93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/9ff8df64-544f-485a-b7a6-350c26419b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/bcd6dc97-74c4-44a0-a8ba-3147080315bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/3dde0aca-1629-4f30-801f-dc915cbf96ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/96fb26bd-3211-4983-bf61-d589cf3fcf30_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fbbf6e0-6ea2-4e5a-b6c9-f9e6fa0a610f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 115302250, 'registration': 'OW25UYT', 'account': 'MOT070', 'make': 'VAUXHALL', 'model': 'CORSA ULTIMATE TURBO', 'derivative': None, 'mileage': 1674, 'mileageWarranty': True, 'type': 'car', 'saleId': 17978, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-15T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2025-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2d9add00-69ec-431a-b59f-6646804901af_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/2598fee5-a9bb-4d48-882c-66fc9fcd2c47_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/78e63196-0324-4ea7-86df-22e1b6a3c93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/9ff8df64-544f-485a-b7a6-350c26419b52_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/bcd6dc97-74c4-44a0-a8ba-3147080315bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/3dde0aca-1629-4f30-801f-dc915cbf96ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/OW25UYT/2025-09-10/image/96fb26bd-3211-4983-bf61-d589cf3fcf30_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Motability Operations', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8fbbf6e0-6ea2-4e5a-b6c9-f9e6fa0a610f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2025-12-04 19:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with scrape type 2
2025-12-04 19:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with scrape type 2
2025-12-04 19:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d2d58f3-1ba0-5125-a962-254cbbade3e3, identifier: 115302250
2025-12-04 19:02:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117372557?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-12-04 19:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014
2025-12-04 19:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2c4a6f82-facb-5dea-9ec4-1f3252c9deaf with identifier: 114344014 to the API
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/114344014?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '2c4a6f82-facb-5dea-9ec4-1f3252c9deaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LO22KXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/114344014',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '3008 DIESEL ESTATE',
 'odometer': 27677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-29',
 'seller_name': 'Motability Operations',
 'title': 'PEUGEOT 3008 DIESEL ESTATE 1.5 BlueHDi GT Premium 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.5 BlueHDi GT Premium 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27114344014%27 HTTP/1.1" 200 None
2025-12-04 19:02:19 [astonbarclay.gb] INFO: Saving data for 114344014: {'auction_closing_time': 1765792800.0, 'created_time': 1764270371.412233, 'last_price_update_time': 1764874939.957219}
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='114344014') HTTP/1.1" 204 0
2025-12-04 19:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2025-12-04 19:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250
2025-12-04 19:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d2d58f3-1ba0-5125-a962-254cbbade3e3 with identifier: 115302250 to the API
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:20 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d2d58f3-1ba0-5125-a962-254cbbade3e3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:19 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115302250?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d2d58f3-1ba0-5125-a962-254cbbade3e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OW25UYT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115302250',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CORSA ULTIMATE TURBO',
 'odometer': 1674,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2025-06-30',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL CORSA ULTIMATE TURBO None',
 'transmission': 'manual',
 'trim': None,
 'vin': None,
 'year': 2025}
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115302250%27 HTTP/1.1" 200 None
2025-12-04 19:02:20 [astonbarclay.gb] INFO: Saving data for 115302250: {'auction_closing_time': 1765792800.0, 'created_time': 1764184355.511845, 'last_price_update_time': 1764874940.248338}
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115302250') HTTP/1.1" 204 0
2025-12-04 19:02:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735830?view=catalogue)
2025-12-04 19:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Ff2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f418d0>
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c77d90>
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252F6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117372557, 'registration': 'SD72UNU', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': '2008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi 110 Active Premium+ 5dr', 'mileage': 41158, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-03', 'fuel': 'Diesel', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD72UNU/2025-11-20/image/292b8662-c2bc-4cb5-94ac-e0bbba29f030_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/90f50ee8-1e7b-43cf-aac6-f477749b78f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/62f7756c-82b6-4822-ad53-f8de748f539d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/8bc166ce-4bb5-440c-9e1a-503313e901d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/58da8399-f88c-433e-85c0-5eb5b62a8a50_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/e31a45ca-cfde-453c-b780-dcdd0a42d4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/3d1320aa-a156-42b0-8594-751c2c4012d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/032c7347-882d-47ea-bb08-abcdc021c79a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/8905b816-92fa-4e01-81ff-502237067302_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23 - 14K, 10/24 - 27K, 10/25 - 39K', 'remarks': '**233**VOSA STATES 39K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/23b02d5b-f07d-4fbe-87a4-d6d009a4ccb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117372557, 'registration': 'SD72UNU', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': '2008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi 110 Active Premium+ 5dr', 'mileage': 41158, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-03', 'fuel': 'Diesel', 'motExpiry': '2026-11-02', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SD72UNU/2025-11-20/image/292b8662-c2bc-4cb5-94ac-e0bbba29f030_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/90f50ee8-1e7b-43cf-aac6-f477749b78f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/62f7756c-82b6-4822-ad53-f8de748f539d_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/8bc166ce-4bb5-440c-9e1a-503313e901d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/58da8399-f88c-433e-85c0-5eb5b62a8a50_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/e31a45ca-cfde-453c-b780-dcdd0a42d4d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/3d1320aa-a156-42b0-8594-751c2c4012d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/032c7347-882d-47ea-bb08-abcdc021c79a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SD72UNU/2025-11-20/image/8905b816-92fa-4e01-81ff-502237067302_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/23 - 14K, 10/24 - 27K, 10/25 - 39K', 'remarks': '**233**VOSA STATES 39K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/23b02d5b-f07d-4fbe-87a4-d6d009a4ccb5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2836ed34-329f-52f1-bcca-7707bffb3476 with identifier: 117372557
2025-12-04 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2836ed34-329f-52f1-bcca-7707bffb3476 with scrape type 2
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2836ed34-329f-52f1-bcca-7707bffb3476 with scrape type 2
2025-12-04 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2836ed34-329f-52f1-bcca-7707bffb3476, identifier: 117372557
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2836ed34-329f-52f1-bcca-7707bffb3476 with identifier: 117372557
2025-12-04 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2836ed34-329f-52f1-bcca-7707bffb3476 with identifier: 117372557
2025-12-04 19:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2836ed34-329f-52f1-bcca-7707bffb3476 with identifier: 117372557 to the API
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117372557?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '2836ed34-329f-52f1-bcca-7707bffb3476',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SD72UNU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117372557',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '2008 DIESEL ESTATE',
 'odometer': 41158,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-03',
 'seller_name': 'Kinto',
 'title': 'PEUGEOT 2008 DIESEL ESTATE 1.5 BlueHDi 110 Active Premium+ 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi 110 Active Premium+ 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117372557%27 HTTP/1.1" 200 None
2025-12-04 19:02:21 [astonbarclay.gb] INFO: Saving data for 117372557: {'auction_closing_time': 1765532700.0, 'created_time': 1764097562.360788, 'last_price_update_time': 1764874941.405615}
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117372557') HTTP/1.1" 204 0
2025-12-04 19:02:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a15790>
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYA17LZF%252F2025-12-03%252Fimage%252Fa247937b-894c-4c89-a8fb-533e61973723_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9
2025-12-04 19:02:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9, skipping ID generation
2025-12-04 19:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 with scrape type 1
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 from tracking dictionaries
2025-12-04 19:02:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 sending to next pipeline
2025-12-04 19:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9, identifier: 117735830
2025-12-04 19:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 with identifier: 117735830
2025-12-04 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 with identifier: 117735830
2025-12-04 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155695 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155695
2025-12-04 19:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 spider: astonbarclay.gb
2025-12-04 19:02:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f235bf4e-7cfd-53dc-a619-7c23f4b59ec9 due to rule: high_mileage_for_country.json, error: 155695 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155695
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f235bf4e-7cfd-53dc-a619-7c23f4b59ec9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YA17LZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117735830',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 SALOON SPECIAL EDITIONS',
 'odometer': 96745,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34435,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a247937b-894c-4c89-a8fb-533e61973723_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32463,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/a4708973-dbcb-4bf4-8d6f-37b97e85fc3d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30810,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/14afe31c-6d2f-4911-80f3-4c2e8b30e047_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31513,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/6b1883e5-1a57-4791-a384-b16eaff121aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51945,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/5c97858f-e192-42a6-88d0-384d7be074e7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47963,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/3a358a2f-a204-4a14-96b2-91714341d32a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41820,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/23fcd172-8193-4ed4-8e60-5137fc0b612b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42903,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/52e797ee-3c7f-472b-8f44-168acd845290_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f235bf4e-7cfd-53dc-a619-7c23f4b59ec9/f235bf4e-7cfd-53dc-a619-7c23f4b59ec9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53311,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/YA17LZF/2025-12-03/image/db84f2a8-35b0-499a-9931-28e82d7e7e0a_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-15',
 'seller_name': 'UKCGR - Premium',
 'title': 'AUDI A3 SALOON SPECIAL EDITIONS 1.6 TDI 116 Black Edition 4dr S '
          'Tronic',
 'transmission': 'automatic',
 'trim': '1.6 TDI 116 Black Edition 4dr S Tronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735830%27 HTTP/1.1" 200 None
2025-12-04 19:02:22 [astonbarclay.gb] INFO: Saving data for 117735830: {'created_time': 1764874942.073031, 'last_price_update_time': 1764874942.073041, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117735830') HTTP/1.1" 204 0
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a1a7d0>
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fa1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fc59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116265155?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ef1ad0>
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116269848?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117253368?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117190749?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117273524?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117119906?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117140269?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116265155, 'registration': 'YP22HDN', 'account': 'KIN032', 'make': 'VOLVO', 'model': 'C40 ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 30199, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-06-08', 'fuel': 'Electric', 'motExpiry': '2026-06-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22HDN/2025-10-13/image/bd914f11-6f51-41ce-8786-f7677e7c395d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/26210c81-80e9-4633-a286-0fa6d249dff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/d724b9af-5fba-4755-ad4e-6ec627a2e190_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/2828b729-993e-4981-afe8-ae9ca1dbb6e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/59208802-7ed6-4316-964f-184803ed903c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/52b0f17d-4c42-459d-bd1c-71818c405a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/e84b4c2e-f445-4321-b33f-aa31127ea2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/cfa8eaab-37c8-4a9e-92df-fb62b4bd24bf_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24 19K', 'remarks': 'VOSA STATES 28K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88864860-3173-44f9-93f7-02b6dd83b642.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116265155, 'registration': 'YP22HDN', 'account': 'KIN032', 'make': 'VOLVO', 'model': 'C40 ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 30199, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-06-08', 'fuel': 'Electric', 'motExpiry': '2026-06-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22HDN/2025-10-13/image/bd914f11-6f51-41ce-8786-f7677e7c395d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/26210c81-80e9-4633-a286-0fa6d249dff1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/d724b9af-5fba-4755-ad4e-6ec627a2e190_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/2828b729-993e-4981-afe8-ae9ca1dbb6e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/59208802-7ed6-4316-964f-184803ed903c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/52b0f17d-4c42-459d-bd1c-71818c405a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/e84b4c2e-f445-4321-b33f-aa31127ea2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22HDN/2025-10-13/image/cfa8eaab-37c8-4a9e-92df-fb62b4bd24bf_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 05/24 19K', 'remarks': 'VOSA STATES 28K, SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88864860-3173-44f9-93f7-02b6dd83b642.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4e42f3a-3739-5e29-a1fe-3e1252630e60 with identifier: 116265155
2025-12-04 19:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4e42f3a-3739-5e29-a1fe-3e1252630e60 with scrape type 2
2025-12-04 19:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4e42f3a-3739-5e29-a1fe-3e1252630e60 with scrape type 2
2025-12-04 19:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b4e42f3a-3739-5e29-a1fe-3e1252630e60, identifier: 116265155
2025-12-04 19:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b4e42f3a-3739-5e29-a1fe-3e1252630e60 with identifier: 116265155
2025-12-04 19:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b4e42f3a-3739-5e29-a1fe-3e1252630e60 with identifier: 116265155
2025-12-04 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'c40 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30199, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116265155', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'yp22hdn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b4e42f3a-3739-5e29-a1fe-3e1252630e60', 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'volvo c40 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 48600} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': 'b4e42f3a-3739-5e29-a1fe-3e1252630e60',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yp22hdn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116265155',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volvo',
     'make_model': 'volvo c40 estate',
     'model': 'c40 estate',
     'odometer': 30199,
     'odometer_in_km': 48600,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-08',
     'sanitized_make': 'volvo',
     'seller_name': 'kinto',
     'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: b4e42f3a-3739-5e29-a1fe-3e1252630e60 spider: astonbarclay.gb
2025-12-04 19:02:23 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b4e42f3a-3739-5e29-a1fe-3e1252630e60 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'c40 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 30199, 'odometer_reading_unit': 'mi', 'registration_date': '2022-06-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116265155', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'yp22hdn', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': 'b4e42f3a-3739-5e29-a1fe-3e1252630e60', 'current_year_diff': 3, 'age_in_months': 41, 'make_model': 'volvo c40 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 48600} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 41,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': 'b4e42f3a-3739-5e29-a1fe-3e1252630e60',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yp22hdn',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116265155',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volvo',
     'make_model': 'volvo c40 estate',
     'model': 'c40 estate',
     'odometer': 30199,
     'odometer_in_km': 48600,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-06-08',
     'sanitized_make': 'volvo',
     'seller_name': 'kinto',
     'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': 'b4e42f3a-3739-5e29-a1fe-3e1252630e60',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YP22HDN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116265155',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLVO',
 'model': 'C40 ESTATE',
 'odometer': 30199,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-08',
 'seller_name': 'Kinto',
 'title': 'VOLVO C40 ESTATE 300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'transmission': 'automatic',
 'trim': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116265155%27 HTTP/1.1" 200 None
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Saving data for 116265155: {'auction_closing_time': 1761210000.0, 'created_time': 1760641501.292858, 'last_price_update_time': 1764874943.147271}
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116265155') HTTP/1.1" 204 0
2025-12-04 19:02:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a2b850>
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116269848, 'registration': 'YR22GFU', 'account': 'KIN032', 'make': 'VOLVO', 'model': 'C40 ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 20358, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-03-18', 'fuel': 'Electric', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR22GFU/2025-10-12/image/723d8611-ae61-49d3-bace-44fc146522f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/4d39a899-44bf-4a07-8e8a-9c3ef3192d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/95438217-2d3a-489f-b2ba-e986325374e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/ce47f756-2ff8-41ce-b8a8-3f71d67ce0ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/19f26e3b-cc0c-4821-9c39-54ddcc6ce360_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/182079b6-4402-49a0-820b-9384ca3e1da3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/b17d7f58-cafa-4ac3-8d91-ec1ec67e4a66_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa states 17k, spare key', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73ffb0cf-ce1d-49c0-b1b4-fdabc759e756.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116269848, 'registration': 'YR22GFU', 'account': 'KIN032', 'make': 'VOLVO', 'model': 'C40 ESTATE', 'derivative': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto', 'mileage': 20358, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2022-03-18', 'fuel': 'Electric', 'motExpiry': '2026-04-07', 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR22GFU/2025-10-12/image/723d8611-ae61-49d3-bace-44fc146522f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/4d39a899-44bf-4a07-8e8a-9c3ef3192d81_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/95438217-2d3a-489f-b2ba-e986325374e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/ce47f756-2ff8-41ce-b8a8-3f71d67ce0ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/19f26e3b-cc0c-4821-9c39-54ddcc6ce360_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/182079b6-4402-49a0-820b-9384ca3e1da3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR22GFU/2025-10-12/image/b17d7f58-cafa-4ac3-8d91-ec1ec67e4a66_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'vosa states 17k, spare key', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73ffb0cf-ce1d-49c0-b1b4-fdabc759e756.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 939f7221-20b3-5d2e-ba33-64615fe5c8cd with identifier: 116269848
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 939f7221-20b3-5d2e-ba33-64615fe5c8cd with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 939f7221-20b3-5d2e-ba33-64615fe5c8cd with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 939f7221-20b3-5d2e-ba33-64615fe5c8cd, identifier: 116269848
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117253368, 'registration': 'FV22KKN', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 39656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-26', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV22KKN/2025-11-17/image/1ada8e83-0427-4e74-8d51-9c3db2a49b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/54d73e7c-b16d-486d-bd7a-09bd04f533d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/ba940780-c1de-4263-9a30-f26f8f8e1f79_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/6b67dcbd-30b4-422f-97cf-98ae6b58ec4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/12c02076-c317-4126-b3cd-b4d87d3f6acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/6fbfae6b-cd41-4ed0-887c-bb5788f7ea2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/e147a082-870a-4d44-a5d0-857c5fbd7660_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/03025495-b290-4c01-9883-c1d36032f547_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/965b3966-1a5e-4daa-9249-ff23d7bad8fa_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/23 - 15K, 01/25 - 29K', 'remarks': '**387**VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf7c2995-4bd2-4cb2-96b2-cefafe237ebb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117253368, 'registration': 'FV22KKN', 'account': 'KIN032', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Allure Premium 5dr', 'mileage': 39656, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-26', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV22KKN/2025-11-17/image/1ada8e83-0427-4e74-8d51-9c3db2a49b0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/54d73e7c-b16d-486d-bd7a-09bd04f533d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/ba940780-c1de-4263-9a30-f26f8f8e1f79_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/6b67dcbd-30b4-422f-97cf-98ae6b58ec4b_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/12c02076-c317-4126-b3cd-b4d87d3f6acb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/6fbfae6b-cd41-4ed0-887c-bb5788f7ea2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/e147a082-870a-4d44-a5d0-857c5fbd7660_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/03025495-b290-4c01-9883-c1d36032f547_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV22KKN/2025-11-17/image/965b3966-1a5e-4daa-9249-ff23d7bad8fa_removebg.jpg?w=600'], 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/23 - 15K, 01/25 - 29K', 'remarks': '**387**VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cf7c2995-4bd2-4cb2-96b2-cefafe237ebb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16e44a4f-f3f9-5801-b987-de38956f7eca with identifier: 117253368
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16e44a4f-f3f9-5801-b987-de38956f7eca with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16e44a4f-f3f9-5801-b987-de38956f7eca with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 16e44a4f-f3f9-5801-b987-de38956f7eca, identifier: 117253368
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117550785, 'registration': 'CP73FYW', 'account': 'UNK001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 4845, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29120e4f-1602-4cdd-912d-0867402ab334.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117550785, 'registration': 'CP73FYW', 'account': 'UNK001', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.0 DiG-T 114 N-Connecta 5dr DCT', 'mileage': 4845, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2023-12-19', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CP73FYW/2025-11-27/image/066e63a7-6e4d-4f10-85a7-d89ef9bf04cc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/69b0a177-7b59-4600-9f86-75283e2ea5dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/d73c5a61-4281-497d-acf3-4bd18e41032a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/c769df9b-ddfb-4cbd-b086-6d22e695616f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/fefa2524-dc36-4cfd-bda3-a45abdaabdb5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/24f1385b-59e3-4b21-bf15-d9e0f678a230_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/f9d3b2db-17e0-4737-aebd-17ff221e8295_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP73FYW/2025-11-27/image/1c7e1b2e-dd20-4f29-b427-9f84db317f1f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': None, 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29120e4f-1602-4cdd-912d-0867402ab334.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bf408e58-6583-5936-b8d5-dfdd53969545 with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bf408e58-6583-5936-b8d5-dfdd53969545 with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bf408e58-6583-5936-b8d5-dfdd53969545, identifier: 117550785
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117190749, 'registration': 'YF71HAO', 'account': 'ZEN002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 57027, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 03/23 18K 03/24 32K 06/25 50K', 'remarks': 'SPARE KEY VOSA STATES 41K 56K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/009c0860-005e-48ca-a312-62f25375f017.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117190749, 'registration': 'YF71HAO', 'account': 'ZEN002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH Acenta Premium 5dr', 'mileage': 57027, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2021-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-29', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service book 03/23 18K 03/24 32K 06/25 50K', 'remarks': 'SPARE KEY VOSA STATES 41K 56K', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/009c0860-005e-48ca-a312-62f25375f017.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 916690dd-9cbe-5afd-9ca4-a3099b4f4a54 with identifier: 117190749
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 916690dd-9cbe-5afd-9ca4-a3099b4f4a54 with scrape type 1
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 916690dd-9cbe-5afd-9ca4-a3099b4f4a54
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 916690dd-9cbe-5afd-9ca4-a3099b4f4a54
2025-12-04 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 916690dd-9cbe-5afd-9ca4-a3099b4f4a54, identifier: 117190749
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117273524, 'registration': 'DA73HFG', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ3 5dr DSG', 'mileage': 14414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA73HFG/2025-11-18/image/c09ff20e-fd09-4e55-87f3-4bcb5716ac9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/8e5bffc9-b83d-4d8b-a3b8-6382c4cc858e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/0697702a-d683-4a13-91c1-ad9e87f97806_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/7df85761-056c-44f6-a92f-41e7df5a5090_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/b13a85cf-14bb-40cc-88de-68731ebd0854_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/d1c952e8-8216-4505-89d5-6c2e47a90aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/ab9dc3d4-16c4-428c-8f17-167a79c36a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/e468d590-8724-4424-96df-7350da50d8d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/3df1b5c4-23d5-4300-9318-f6d1852905cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 9K', 'remarks': '**255** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd068703-d34c-489f-a66c-6a010ee7f313.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117273524, 'registration': 'DA73HFG', 'account': 'KIN032', 'make': 'CUPRA', 'model': 'LEON HATCHBACK', 'derivative': '1.4 eHybrid VZ3 5dr DSG', 'mileage': 14414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2023-11-15', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': None, 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DA73HFG/2025-11-18/image/c09ff20e-fd09-4e55-87f3-4bcb5716ac9c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/8e5bffc9-b83d-4d8b-a3b8-6382c4cc858e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/0697702a-d683-4a13-91c1-ad9e87f97806_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/7df85761-056c-44f6-a92f-41e7df5a5090_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/b13a85cf-14bb-40cc-88de-68731ebd0854_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/d1c952e8-8216-4505-89d5-6c2e47a90aa2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/ab9dc3d4-16c4-428c-8f17-167a79c36a5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/e468d590-8724-4424-96df-7350da50d8d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DA73HFG/2025-11-18/image/3df1b5c4-23d5-4300-9318-f6d1852905cf_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/25 - 9K', 'remarks': '**255** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 29, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/cd068703-d34c-489f-a66c-6a010ee7f313.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9350fcc7-2097-5be5-96b6-e78c34c3d2da with identifier: 117273524
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9350fcc7-2097-5be5-96b6-e78c34c3d2da with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9350fcc7-2097-5be5-96b6-e78c34c3d2da with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9350fcc7-2097-5be5-96b6-e78c34c3d2da, identifier: 117273524
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117119906, 'registration': 'YR72PTO', 'account': 'KIN032', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 55905, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-04', 'fuel': 'Petrol', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR72PTO/2025-11-11/image/bdf97173-b30c-4527-9726-dab885e25717_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/c233030a-012f-4476-a758-f75e477014b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/cf286095-bcb4-4ffa-96db-89ce87b543e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/c23a7455-148c-49a4-8368-7ead82bed23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/839ef8b0-8483-475c-9e93-77576952774c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/b60f67c7-ebae-4a46-928e-6bf931a3df2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/23d2c395-f5e0-4e41-9ef7-957548bd4e78_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/57beaf42-8096-4d16-8eb8-ca9efad215b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/de870c5b-c289-486f-8260-80ceebf96c07_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23- 18K, 10/24- 37K, 10/25- 55K', 'remarks': '**364** VOSA STATES 55K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c801e713-5b0e-4d57-aa66-d58ac64eec58.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117119906, 'registration': 'YR72PTO', 'account': 'KIN032', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV Titanium 5dr', 'mileage': 55905, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-04', 'fuel': 'Petrol', 'motExpiry': '2026-11-03', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YR72PTO/2025-11-11/image/bdf97173-b30c-4527-9726-dab885e25717_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/c233030a-012f-4476-a758-f75e477014b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/cf286095-bcb4-4ffa-96db-89ce87b543e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/c23a7455-148c-49a4-8368-7ead82bed23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/839ef8b0-8483-475c-9e93-77576952774c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/b60f67c7-ebae-4a46-928e-6bf931a3df2b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/23d2c395-f5e0-4e41-9ef7-957548bd4e78_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/57beaf42-8096-4d16-8eb8-ca9efad215b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR72PTO/2025-11-11/image/de870c5b-c289-486f-8260-80ceebf96c07_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/23- 18K, 10/24- 37K, 10/25- 55K', 'remarks': '**364** VOSA STATES 55K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c801e713-5b0e-4d57-aa66-d58ac64eec58.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9324ba3-9dc9-52d5-be75-e822409b7117 with identifier: 117119906
2025-12-04 19:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9324ba3-9dc9-52d5-be75-e822409b7117 with scrape type 2
2025-12-04 19:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9324ba3-9dc9-52d5-be75-e822409b7117 with scrape type 2
2025-12-04 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b9324ba3-9dc9-52d5-be75-e822409b7117, identifier: 117119906
2025-12-04 19:02:24 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117140269, 'registration': 'RO22SSJ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 40369, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/09b7988f-2a80-46ff-a2bc-0ed4481b893c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/a68095f8-3c4f-4e5f-88df-6ad2668f5639_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/e6a1e91f-c369-469b-98bc-abfad80d0401_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/a963cfd3-7bcd-4eef-8f14-5d2ba5af1e55_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/86aa5e10-bcd2-42fc-ab51-04ff7611fd7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/ea4bd0f7-5e0a-4979-a68f-e62895f6ad33_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/ee73c286-78a4-4899-a186-3cb55ac4dfa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/4c5ca491-9ece-4e7c-ba52-ae2274913036_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/2e8c0bfd-4caf-40f6-9442-fda07a90fe52_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/24- 23K', 'remarks': '**1408** VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6377c28-b0bf-4e70-b8b1-93d9b9b224e3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:24 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117140269, 'registration': 'RO22SSJ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 40369, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/09b7988f-2a80-46ff-a2bc-0ed4481b893c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/a68095f8-3c4f-4e5f-88df-6ad2668f5639_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/e6a1e91f-c369-469b-98bc-abfad80d0401_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/a963cfd3-7bcd-4eef-8f14-5d2ba5af1e55_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/86aa5e10-bcd2-42fc-ab51-04ff7611fd7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/ea4bd0f7-5e0a-4979-a68f-e62895f6ad33_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/ee73c286-78a4-4899-a186-3cb55ac4dfa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/4c5ca491-9ece-4e7c-ba52-ae2274913036_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22SSJ/2025-11-17/image/2e8c0bfd-4caf-40f6-9442-fda07a90fe52_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 05/24- 23K', 'remarks': '**1408** VOSA STATES 34K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c6377c28-b0bf-4e70-b8b1-93d9b9b224e3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d404c8a-3a8c-5b77-8516-414df66993a9 with identifier: 117140269
2025-12-04 19:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d404c8a-3a8c-5b77-8516-414df66993a9 with scrape type 2
2025-12-04 19:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d404c8a-3a8c-5b77-8516-414df66993a9 with scrape type 2
2025-12-04 19:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5d404c8a-3a8c-5b77-8516-414df66993a9, identifier: 117140269
2025-12-04 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 939f7221-20b3-5d2e-ba33-64615fe5c8cd with identifier: 116269848
2025-12-04 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 939f7221-20b3-5d2e-ba33-64615fe5c8cd with identifier: 116269848
2025-12-04 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'c40 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20358, 'odometer_reading_unit': 'mi', 'registration_date': '2022-03-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116269848', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'yr22gfu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '939f7221-20b3-5d2e-ba33-64615fe5c8cd', 'current_year_diff': 3, 'age_in_months': 44, 'make_model': 'volvo c40 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 32762} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 44,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '939f7221-20b3-5d2e-ba33-64615fe5c8cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yr22gfu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116269848',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volvo',
     'make_model': 'volvo c40 estate',
     'model': 'c40 estate',
     'odometer': 20358,
     'odometer_in_km': 32762,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-18',
     'sanitized_make': 'volvo',
     'seller_name': 'kinto',
     'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 939f7221-20b3-5d2e-ba33-64615fe5c8cd spider: astonbarclay.gb
2025-12-04 19:02:24 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 939f7221-20b3-5d2e-ba33-64615fe5c8cd due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto', 'price': 0, 'currency': 'gbp', 'make': 'volvo', 'model': 'c40 estate', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 20358, 'odometer_reading_unit': 'mi', 'registration_date': '2022-03-18', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116269848', 'expiration_date': None, 'location': 'aston barclay donington park', 'origin_country_code': 'gb', 'trim': '300kw recharge twin pro 78kwh 5dr awd auto', 'license_plate': 'yr22gfu', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '939f7221-20b3-5d2e-ba33-64615fe5c8cd', 'current_year_diff': 3, 'age_in_months': 44, 'make_model': 'volvo c40 estate', 'sanitized_make': 'volvo', 'odometer_in_km': 32762} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 44,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': None,
     'fuel_type': 'electric',
     'id': '939f7221-20b3-5d2e-ba33-64615fe5c8cd',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'yr22gfu',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116269848',
     'listing': 'auction',
     'location': 'aston barclay donington park',
     'make': 'volvo',
     'make_model': 'volvo c40 estate',
     'model': 'c40 estate',
     'odometer': 20358,
     'odometer_in_km': 32762,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-03-18',
     'sanitized_make': 'volvo',
     'seller_name': 'kinto',
     'title': 'volvo c40 estate 300kw recharge twin pro 78kwh 5dr awd auto',
     'transmission': 'automatic',
     'trim': '300kw recharge twin pro 78kwh 5dr awd auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': None,
 'fuel_type': 'Electric',
 'id': '939f7221-20b3-5d2e-ba33-64615fe5c8cd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YR22GFU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116269848',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VOLVO',
 'model': 'C40 ESTATE',
 'odometer': 20358,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-18',
 'seller_name': 'Kinto',
 'title': 'VOLVO C40 ESTATE 300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'transmission': 'automatic',
 'trim': '300kW Recharge Twin Pro 78kWh 5dr AWD Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116269848%27 HTTP/1.1" 200 None
2025-12-04 19:02:24 [astonbarclay.gb] INFO: Saving data for 116269848: {'auction_closing_time': 1761210000.0, 'created_time': 1760641386.390318, 'last_price_update_time': 1764874944.314869}
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116269848') HTTP/1.1" 204 0
2025-12-04 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 16e44a4f-f3f9-5801-b987-de38956f7eca with identifier: 117253368
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=ORANGE HTTP/1.1" 200 None
2025-12-04 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 16e44a4f-f3f9-5801-b987-de38956f7eca with identifier: 117253368
2025-12-04 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 16e44a4f-f3f9-5801-b987-de38956f7eca with identifier: 117253368 to the API
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117253368?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '16e44a4f-f3f9-5801-b987-de38956f7eca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV22KKN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117253368',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 39656,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-26',
 'seller_name': 'Kinto',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Allure Premium 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure Premium 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117253368%27 HTTP/1.1" 200 None
2025-12-04 19:02:24 [astonbarclay.gb] INFO: Saving data for 117253368: {'auction_closing_time': 1765532700.0, 'created_time': 1763751870.902126, 'last_price_update_time': 1764874944.737499}
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117253368') HTTP/1.1" 204 0
2025-12-04 19:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-12-04 19:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785
2025-12-04 19:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bf408e58-6583-5936-b8d5-dfdd53969545 with identifier: 117550785 to the API
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117550785?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': 'bf408e58-6583-5936-b8d5-dfdd53969545',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP73FYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117550785',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 4845,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-19',
 'seller_name': None,
 'title': 'NISSAN JUKE HATCHBACK 1.0 DiG-T 114 N-Connecta 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0 DiG-T 114 N-Connecta 5dr DCT',
 'vin': None,
 'year': 2023}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117550785%27 HTTP/1.1" 200 None
2025-12-04 19:02:25 [astonbarclay.gb] INFO: Saving data for 117550785: {'created_time': 1764270432.539068, 'last_price_update_time': 1764874945.073678}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117550785') HTTP/1.1" 204 0
2025-12-04 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 916690dd-9cbe-5afd-9ca4-a3099b4f4a54 with identifier: 117190749
2025-12-04 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 916690dd-9cbe-5afd-9ca4-a3099b4f4a54 with identifier: 117190749
2025-12-04 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 916690dd-9cbe-5afd-9ca4-a3099b4f4a54 with identifier: 117190749 to the API
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27916690dd-9cbe-5afd-9ca4-a3099b4f4a54%27 HTTP/1.1" 200 None
2025-12-04 19:02:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 916690dd-9cbe-5afd-9ca4-a3099b4f4a54: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117190749?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': None,
 'fuel_type': 'Petrol',
 'id': '916690dd-9cbe-5afd-9ca4-a3099b4f4a54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YF71HAO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117190749',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 57027,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-30',
 'seller_name': 'Zenith',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH Acenta Premium 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH Acenta Premium 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117190749%27 HTTP/1.1" 200 None
2025-12-04 19:02:25 [astonbarclay.gb] INFO: Saving data for 117190749: {'created_time': 1764874945.37217, 'last_price_update_time': 1764874945.372179}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117190749') HTTP/1.1" 204 0
2025-12-04 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9350fcc7-2097-5be5-96b6-e78c34c3d2da with identifier: 117273524
2025-12-04 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9350fcc7-2097-5be5-96b6-e78c34c3d2da with identifier: 117273524
2025-12-04 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9350fcc7-2097-5be5-96b6-e78c34c3d2da with identifier: 117273524 to the API
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117273524?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '9350fcc7-2097-5be5-96b6-e78c34c3d2da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DA73HFG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117273524',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'LEON HATCHBACK',
 'odometer': 14414,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-15',
 'seller_name': 'Kinto',
 'title': 'CUPRA LEON HATCHBACK 1.4 eHybrid VZ3 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ3 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117273524%27 HTTP/1.1" 200 None
2025-12-04 19:02:25 [astonbarclay.gb] INFO: Saving data for 117273524: {'auction_closing_time': 1765532700.0, 'created_time': 1764010945.600181, 'last_price_update_time': 1764874945.666883}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117273524') HTTP/1.1" 204 0
2025-12-04 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b9324ba3-9dc9-52d5-be75-e822409b7117 with identifier: 117119906
2025-12-04 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b9324ba3-9dc9-52d5-be75-e822409b7117 with identifier: 117119906
2025-12-04 19:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b9324ba3-9dc9-52d5-be75-e822409b7117 with identifier: 117119906 to the API
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117119906?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'b9324ba3-9dc9-52d5-be75-e822409b7117',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YR72PTO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117119906',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 55905,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-04',
 'seller_name': 'Kinto',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV Titanium 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117119906%27 HTTP/1.1" 200 None
2025-12-04 19:02:25 [astonbarclay.gb] INFO: Saving data for 117119906: {'auction_closing_time': 1765532700.0, 'created_time': 1763579014.835159, 'last_price_update_time': 1764874945.96696}
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117119906') HTTP/1.1" 204 0
2025-12-04 19:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5d404c8a-3a8c-5b77-8516-414df66993a9 with identifier: 117140269
2025-12-04 19:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5d404c8a-3a8c-5b77-8516-414df66993a9 with identifier: 117140269
2025-12-04 19:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5d404c8a-3a8c-5b77-8516-414df66993a9 with identifier: 117140269 to the API
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117140269?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '5d404c8a-3a8c-5b77-8516-414df66993a9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RO22SSJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140269',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 40369,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-16',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140269%27 HTTP/1.1" 200 None
2025-12-04 19:02:26 [astonbarclay.gb] INFO: Saving data for 117140269: {'auction_closing_time': 1765532700.0, 'created_time': 1764666059.397412, 'last_price_update_time': 1764874946.250254}
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117140269') HTTP/1.1" 204 0
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117767677?view=catalogue)
2025-12-04 19:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117106625?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6873cd0>
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fc59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a0d310>
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Fa1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c40290>
2025-12-04 19:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252Ff2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c32c90>
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48d7050>
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c33cd0>
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLV72ULD%252F2025-12-04%252Fimage%252F457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 563606a8-a7b4-5f11-a24b-0099219bc718
2025-12-04 19:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 563606a8-a7b4-5f11-a24b-0099219bc718, skipping ID generation
2025-12-04 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 563606a8-a7b4-5f11-a24b-0099219bc718 with scrape type 1
2025-12-04 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 563606a8-a7b4-5f11-a24b-0099219bc718 from tracking dictionaries
2025-12-04 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 563606a8-a7b4-5f11-a24b-0099219bc718 sending to next pipeline
2025-12-04 19:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 563606a8-a7b4-5f11-a24b-0099219bc718, identifier: 117767677
2025-12-04 19:02:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117106625, 'registration': 'KM71YKX', 'account': 'KIN032', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e xDrive Sport Pro 5dr Step Auto', 'mileage': 72013, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM71YKX/2025-11-11/image/eb5718b7-8b46-4cf3-aca3-b4f62adfb038_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/d4f28262-1bd4-46b0-b428-17e8d22bacfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/a9031089-71cb-44db-acf9-f1628d2e29be_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/d466ff02-b2a9-4975-a53e-d07013203d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/59e84177-5d6f-40b3-9afd-fb030336eb82_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/e7ffdc84-3696-4c91-8657-92b6c016b9ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/ecfe50ae-e55d-4e1c-857e-9d7c87e52b5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/93c4fd62-e8a6-4cfe-86ff-ad15894acb35_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f2eee64-dbe8-4bb6-8165-c3ee0eaa8c27.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117106625, 'registration': 'KM71YKX', 'account': 'KIN032', 'make': 'BMW', 'model': '3 SERIES TOURING', 'derivative': '330e xDrive Sport Pro 5dr Step Auto', 'mileage': 72013, 'mileageWarranty': True, 'type': 'car', 'saleId': 0, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': None, 'lot': None, 'hall': None, 'transmission': 'automatic', 'firstRegistration': '2021-11-29', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-28', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM71YKX/2025-11-11/image/eb5718b7-8b46-4cf3-aca3-b4f62adfb038_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/d4f28262-1bd4-46b0-b428-17e8d22bacfa_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/a9031089-71cb-44db-acf9-f1628d2e29be_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/d466ff02-b2a9-4975-a53e-d07013203d41_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/59e84177-5d6f-40b3-9afd-fb030336eb82_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/e7ffdc84-3696-4c91-8657-92b6c016b9ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/ecfe50ae-e55d-4e1c-857e-9d7c87e52b5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM71YKX/2025-11-11/image/93c4fd62-e8a6-4cfe-86ff-ad15894acb35_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 40, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1f2eee64-dbe8-4bb6-8165-c3ee0eaa8c27.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with identifier: 117106625
2025-12-04 19:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with scrape type 2
2025-12-04 19:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with scrape type 2
2025-12-04 19:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d, identifier: 117106625
2025-12-04 19:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 563606a8-a7b4-5f11-a24b-0099219bc718 with identifier: 117767677
2025-12-04 19:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 563606a8-a7b4-5f11-a24b-0099219bc718 with identifier: 117767677
2025-12-04 19:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 563606a8-a7b4-5f11-a24b-0099219bc718 with identifier: 117767677 to the API
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-15T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '563606a8-a7b4-5f11-a24b-0099219bc718',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV72ULD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117767677',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'MOKKA HATCHBACK',
 'odometer': 15293,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36276,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/082f5e9a-90a4-43f7-8277-43df95577aa2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/f2ffdbdd-fc59-4c0c-8e3e-69fb6470097f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29085,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/3c0d8c55-6ec4-4ec7-b5db-a2f76fbd0c75_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29445,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/8993863b-786d-4b57-9fa3-e99e43b440a3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34649,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/2377a9ba-412c-4de2-a299-e5a10e0d4b9c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46400,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/457490e4-93ce-41b4-a105-13122fcecfc3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46811,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/ee19ce76-2263-4fb5-996e-20c46e50eb1d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45618,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/a1e37738-8b9b-4ca0-9323-64ced4723a3a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_563606a8-a7b4-5f11-a24b-0099219bc718/563606a8-a7b4-5f11-a24b-0099219bc718_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33460,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LV72ULD/2025-12-04/image/c59324b6-9bc2-466c-b041-f58c80e68e1d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-05',
 'seller_name': 'Motability Operations',
 'title': 'VAUXHALL MOKKA HATCHBACK 1.2 Turbo Ultimate 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.2 Turbo Ultimate 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767677%27 HTTP/1.1" 200 None
2025-12-04 19:02:28 [astonbarclay.gb] INFO: Saving data for 117767677: {'created_time': 1764874948.58094, 'last_price_update_time': 1764874948.58095, 'auction_closing_time': 1765792800.0}
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117767677') HTTP/1.1" 204 0
2025-12-04 19:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with identifier: 117106625
2025-12-04 19:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with identifier: 117106625
2025-12-04 19:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d with identifier: 117106625 to the API
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117106625?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 40,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': None,
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': 'c7ceb22d-5bc8-54b5-b527-2dc4ea2bf31d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'KM71YKX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117106625',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'BMW',
 'model': '3 SERIES TOURING',
 'odometer': 72013,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-29',
 'seller_name': 'Kinto',
 'title': 'BMW 3 SERIES TOURING 330e xDrive Sport Pro 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '330e xDrive Sport Pro 5dr Step Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117106625%27 HTTP/1.1" 200 None
2025-12-04 19:02:28 [astonbarclay.gb] INFO: Saving data for 117106625: {'created_time': 1762888205.909096, 'last_price_update_time': 1764874948.907826}
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117106625') HTTP/1.1" 204 0
2025-12-04 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117362589?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117230187?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117194162?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117120453?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117242944?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117140308?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:29 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117362589, 'registration': 'RO22XBD', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO22XBD/2025-11-20/image/3fcd8d0e-d44b-41b8-93c7-28ca823613f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/af1a906c-1197-4b2d-9d6a-91169125539b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/a9a500f7-8651-4cd9-a490-8dc85e7f352a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/21c44e29-fedb-4b73-b901-4a06f4995e38_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/473819f0-2065-4ea7-964d-4844afd72a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/85e8de4e-1c71-4ee8-84a9-da0034234def_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/a5198be3-a607-453a-b1e4-afdb897d57c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/488b48b0-e0fc-4521-a0ec-f47dd1c88b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/53a1e9bb-b009-4c22-9044-d67486e18663_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/24 - 20K, 09/25 - 29K,', 'remarks': '**261**VOSA STATES 26K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7dd4e0b6-32bf-40cf-9ee8-a6fe4596d3c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117362589, 'registration': 'RO22XBD', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI Life 5dr', 'mileage': 33300, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-19', 'fuel': 'Diesel', 'motExpiry': '2026-05-18', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RO22XBD/2025-11-20/image/3fcd8d0e-d44b-41b8-93c7-28ca823613f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/af1a906c-1197-4b2d-9d6a-91169125539b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/a9a500f7-8651-4cd9-a490-8dc85e7f352a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/21c44e29-fedb-4b73-b901-4a06f4995e38_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/473819f0-2065-4ea7-964d-4844afd72a34_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/85e8de4e-1c71-4ee8-84a9-da0034234def_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/a5198be3-a607-453a-b1e4-afdb897d57c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/488b48b0-e0fc-4521-a0ec-f47dd1c88b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RO22XBD/2025-11-20/image/53a1e9bb-b009-4c22-9044-d67486e18663_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 09/24 - 20K, 09/25 - 29K,', 'remarks': '**261**VOSA STATES 26K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7dd4e0b6-32bf-40cf-9ee8-a6fe4596d3c0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fa61579-744d-508d-b59d-a8951c73fa67 with identifier: 117362589
2025-12-04 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fa61579-744d-508d-b59d-a8951c73fa67 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fa61579-744d-508d-b59d-a8951c73fa67 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8fa61579-744d-508d-b59d-a8951c73fa67, identifier: 117362589
2025-12-04 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8fa61579-744d-508d-b59d-a8951c73fa67 with identifier: 117362589
2025-12-04 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8fa61579-744d-508d-b59d-a8951c73fa67 with identifier: 117362589
2025-12-04 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 8fa61579-744d-508d-b59d-a8951c73fa67 with identifier: 117362589 to the API
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117362589?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '8fa61579-744d-508d-b59d-a8951c73fa67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RO22XBD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117362589',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 33300,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-19',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI Life 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117362589%27 HTTP/1.1" 200 None
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Saving data for 117362589: {'auction_closing_time': 1765532700.0, 'created_time': 1764097569.326372, 'last_price_update_time': 1764874949.398718}
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117362589') HTTP/1.1" 204 0
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117230187, 'registration': 'WN71VLD', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL SALOON', 'derivative': 'A180d [2.0] Sport 4dr Auto', 'mileage': 51135, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-30', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WN71VLD/2025-11-17/image/90ad3bd8-94c7-46e2-93eb-c00d1eb78169_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/aa0894ba-593f-4d6c-bd45-b30d39f036d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/20bb7284-c553-48ab-b80a-fba16ad05b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/a32c4346-b649-497a-aa0b-96d30f062150_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/3da8adf2-b67c-4cc6-b5be-89dc0aa8be64_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/3ea52ca1-a95d-43fc-9948-8cf6f720d17b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/50091d4c-b490-432b-9112-76fb47d7f598_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/51874519-d491-4852-9707-7ede9283ebbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/29b7d4ef-7a5d-480b-b8c0-925711ec1914_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/23 - 19K, 03/24 - 31K, 05/25 - 43K,', 'remarks': '**388**VOSA STATES 36K, 48K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eec7c5a9-5f34-4f7a-a0d3-f8fc12d0cd40.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117230187, 'registration': 'WN71VLD', 'account': 'KIN032', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL SALOON', 'derivative': 'A180d [2.0] Sport 4dr Auto', 'mileage': 51135, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-11-17', 'fuel': 'Diesel', 'motExpiry': '2026-09-30', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WN71VLD/2025-11-17/image/90ad3bd8-94c7-46e2-93eb-c00d1eb78169_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/aa0894ba-593f-4d6c-bd45-b30d39f036d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/20bb7284-c553-48ab-b80a-fba16ad05b1e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/a32c4346-b649-497a-aa0b-96d30f062150_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/3da8adf2-b67c-4cc6-b5be-89dc0aa8be64_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/3ea52ca1-a95d-43fc-9948-8cf6f720d17b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/50091d4c-b490-432b-9112-76fb47d7f598_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/51874519-d491-4852-9707-7ede9283ebbb_removebg.jpg?w=600', 'https://abimg003.imgix.net/WN71VLD/2025-11-17/image/29b7d4ef-7a5d-480b-b8c0-925711ec1914_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/23 - 19K, 03/24 - 31K, 05/25 - 43K,', 'remarks': '**388**VOSA STATES 36K, 48K  SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eec7c5a9-5f34-4f7a-a0d3-f8fc12d0cd40.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb56cde0-bc59-50a2-b708-fc1701ed4642 with identifier: 117230187
2025-12-04 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb56cde0-bc59-50a2-b708-fc1701ed4642 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb56cde0-bc59-50a2-b708-fc1701ed4642 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bb56cde0-bc59-50a2-b708-fc1701ed4642, identifier: 117230187
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117194162, 'registration': 'YS23PZG', 'account': 'KIN032', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 13836, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-05-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS23PZG/2025-11-13/image/e34c4bba-9e85-4425-8f7a-6d9ef16ec97f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/cca25220-e559-4a10-9c89-3e7701e2049e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/8dd835e1-a2c5-4806-b61e-8bafeb638dd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/5bbbd5f1-65cd-4bf9-803c-71b2c20e1736_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/e35e1706-3ef6-4368-ba89-dc350503282a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/7484d649-d7f2-451d-b165-d3fac40fd486_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/2ad67d60-33eb-4499-8d6d-ecc9cab0e252_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/9fe50e97-90ab-4417-88cb-b0cd8b062fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/9e66901a-9418-4444-8afd-02d704c4dc51_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25- 10k,', 'remarks': '**268** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8dffda82-3049-40b0-8ae3-8a40f60a026b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117194162, 'registration': 'YS23PZG', 'account': 'KIN032', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 13836, 'mileageWarranty': False, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-05-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS23PZG/2025-11-13/image/e34c4bba-9e85-4425-8f7a-6d9ef16ec97f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/cca25220-e559-4a10-9c89-3e7701e2049e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/8dd835e1-a2c5-4806-b61e-8bafeb638dd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/5bbbd5f1-65cd-4bf9-803c-71b2c20e1736_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/e35e1706-3ef6-4368-ba89-dc350503282a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/7484d649-d7f2-451d-b165-d3fac40fd486_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/2ad67d60-33eb-4499-8d6d-ecc9cab0e252_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/9fe50e97-90ab-4417-88cb-b0cd8b062fec_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS23PZG/2025-11-13/image/9e66901a-9418-4444-8afd-02d704c4dc51_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25- 10k,', 'remarks': '**268** SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8dffda82-3049-40b0-8ae3-8a40f60a026b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f049324-679a-5661-940a-2b82e149ffb7 with identifier: 117194162
2025-12-04 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f049324-679a-5661-940a-2b82e149ffb7 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f049324-679a-5661-940a-2b82e149ffb7 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f049324-679a-5661-940a-2b82e149ffb7, identifier: 117194162
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117120453, 'registration': 'ST72AZA', 'account': 'KIN032', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr', 'mileage': 28910, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST72AZA/2025-11-11/image/90a1b555-26a7-4586-ae85-dca9f8f09744_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/c2d05b4f-c61a-46e8-8b5c-adfd83907e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/b3034557-0247-4ca3-a69e-10a2c4330e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4e947590-7e03-4fac-bf0c-c809fe48caeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/082844e6-e739-4d26-934f-6ba40c0f93f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/a2623dbc-84c4-4ae3-bec8-40c7d5f2cde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7f4e54e4-f19a-475c-8474-b89e8528682e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4286dcdf-0079-4839-bf4d-2cc6e8b4e170_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7345b254-3cd0-4b86-804e-cce65c31f31c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 18K', 'remarks': '**340** VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c01d5c12-8487-41d6-9f51-07b38b637e49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117120453, 'registration': 'ST72AZA', 'account': 'KIN032', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr', 'mileage': 28910, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-11-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-09', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ST72AZA/2025-11-11/image/90a1b555-26a7-4586-ae85-dca9f8f09744_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/c2d05b4f-c61a-46e8-8b5c-adfd83907e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/b3034557-0247-4ca3-a69e-10a2c4330e1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4e947590-7e03-4fac-bf0c-c809fe48caeb_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/082844e6-e739-4d26-934f-6ba40c0f93f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/a2623dbc-84c4-4ae3-bec8-40c7d5f2cde3_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7f4e54e4-f19a-475c-8474-b89e8528682e_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/4286dcdf-0079-4839-bf4d-2cc6e8b4e170_removebg.jpg?w=600', 'https://abimg003.imgix.net/ST72AZA/2025-11-11/image/7345b254-3cd0-4b86-804e-cce65c31f31c_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/24 - 18K', 'remarks': '**340** VOSA STATES 28K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 115, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c01d5c12-8487-41d6-9f51-07b38b637e49.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-12-04 19:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb3530c1-d232-51cb-a7a1-5bd70c78e942 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb3530c1-d232-51cb-a7a1-5bd70c78e942 with scrape type 2
2025-12-04 19:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb3530c1-d232-51cb-a7a1-5bd70c78e942, identifier: 117120453
2025-12-04 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bb56cde0-bc59-50a2-b708-fc1701ed4642 with identifier: 117230187
2025-12-04 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bb56cde0-bc59-50a2-b708-fc1701ed4642 with identifier: 117230187
2025-12-04 19:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: bb56cde0-bc59-50a2-b708-fc1701ed4642 with identifier: 117230187 to the API
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117230187?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'bb56cde0-bc59-50a2-b708-fc1701ed4642',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'WN71VLD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117230187',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS DIESEL SALOON',
 'odometer': 51135,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-17',
 'seller_name': 'Kinto',
 'title': 'MERCEDES-BENZ A CLASS DIESEL SALOON A180d [2.0] Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d [2.0] Sport 4dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117230187%27 HTTP/1.1" 200 None
2025-12-04 19:02:29 [astonbarclay.gb] INFO: Saving data for 117230187: {'auction_closing_time': 1765532700.0, 'created_time': 1763751867.775748, 'last_price_update_time': 1764874949.955295}
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117230187') HTTP/1.1" 204 0
2025-12-04 19:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f049324-679a-5661-940a-2b82e149ffb7 with identifier: 117194162
2025-12-04 19:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f049324-679a-5661-940a-2b82e149ffb7 with identifier: 117194162
2025-12-04 19:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4f049324-679a-5661-940a-2b82e149ffb7 with identifier: 117194162 to the API
2025-12-04 19:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117194162?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '4f049324-679a-5661-940a-2b82e149ffb7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YS23PZG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117194162',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 13836,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-05-30',
 'seller_name': 'Kinto',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117194162%27 HTTP/1.1" 200 None
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Saving data for 117194162: {'auction_closing_time': 1765532700.0, 'created_time': 1764010934.615492, 'last_price_update_time': 1764874951.271874}
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117194162') HTTP/1.1" 204 0
2025-12-04 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-12-04 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453
2025-12-04 19:02:31 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb3530c1-d232-51cb-a7a1-5bd70c78e942 with identifier: 117120453 to the API
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117120453?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb3530c1-d232-51cb-a7a1-5bd70c78e942',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'ST72AZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117120453',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 28910,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-11-10',
 'seller_name': 'Kinto',
 'title': 'FORD FIESTA HATCHBACK 1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV 125 ST-Line 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117120453%27 HTTP/1.1" 200 None
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Saving data for 117120453: {'auction_closing_time': 1765532700.0, 'created_time': 1763579014.462269, 'last_price_update_time': 1764874951.616783}
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117120453') HTTP/1.1" 204 0
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117242944, 'registration': 'VK22WKW', 'account': 'KIN032', 'make': 'FIAT', 'model': '500 ELECTRIC HATCHBACK', 'derivative': '87kW Icon 42kWh 3dr Auto', 'mileage': 4828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-25', 'fuel': 'Electric', 'motExpiry': '2026-10-28', 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK22WKW/2025-11-17/image/4db23755-3e6e-42c8-a801-dc750dc00e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/7ca5204b-a35f-47d6-bf6c-6416f6a98214_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/4d495155-d491-4d55-b9d2-801e638e7d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/fe0d8374-772a-42ac-b46b-5b9c62ea7b15_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/faee2171-accf-4372-8a09-f991629a1d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/401add19-8793-44aa-969e-fa24f23b116b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/2f47907f-f868-4d19-b9b5-a36a15f1dc2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/ba6fae42-3c22-4863-a486-878e42fd66d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/870a3938-dab2-4b4b-8912-a04419211828_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**329**  VOSA STATES 4K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79641d7c-577e-4afc-96c2-6247b3721cb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117242944, 'registration': 'VK22WKW', 'account': 'KIN032', 'make': 'FIAT', 'model': '500 ELECTRIC HATCHBACK', 'derivative': '87kW Icon 42kWh 3dr Auto', 'mileage': 4828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-25', 'fuel': 'Electric', 'motExpiry': '2026-10-28', 'doors': 3, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK22WKW/2025-11-17/image/4db23755-3e6e-42c8-a801-dc750dc00e96_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/7ca5204b-a35f-47d6-bf6c-6416f6a98214_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/4d495155-d491-4d55-b9d2-801e638e7d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/fe0d8374-772a-42ac-b46b-5b9c62ea7b15_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/faee2171-accf-4372-8a09-f991629a1d6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/401add19-8793-44aa-969e-fa24f23b116b_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/2f47907f-f868-4d19-b9b5-a36a15f1dc2f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/ba6fae42-3c22-4863-a486-878e42fd66d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK22WKW/2025-11-17/image/870a3938-dab2-4b4b-8912-a04419211828_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**329**  VOSA STATES 4K', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/79641d7c-577e-4afc-96c2-6247b3721cb3.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67cf49ea-a185-5717-9f82-44481b4967c7 with identifier: 117242944
2025-12-04 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67cf49ea-a185-5717-9f82-44481b4967c7 with scrape type 2
2025-12-04 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67cf49ea-a185-5717-9f82-44481b4967c7 with scrape type 2
2025-12-04 19:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67cf49ea-a185-5717-9f82-44481b4967c7, identifier: 117242944
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117140308, 'registration': 'SW72AXC', 'account': 'KIN032', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK', 'derivative': '125kW 35 55kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 31261, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SW72AXC/2025-11-12/image/deb100a6-51d5-434c-b91e-983a70e14481_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/b4d35349-a948-421c-aa65-b4219b1c72b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/7247d9ae-3e21-4778-92be-2efbef26ad89_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/4d142f87-0c89-4a2e-9cfd-b15f0a521ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/15ce1493-aecd-48c4-b0e2-f1824aa0da04_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/e571ddeb-bdcc-45ee-a097-aa747249734f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/27c26cd8-b9b3-41bd-94ee-8a32f9a70034_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/3d7b72e6-319f-4623-91e4-f994ea2eb096_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/d41dcde1-358d-4400-91ee-356352d3cfb3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24- 20K,', 'remarks': '**287**', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce563600-1e83-4ac1-923c-33bcf08b9c98.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117140308, 'registration': 'SW72AXC', 'account': 'KIN032', 'make': 'AUDI', 'model': 'Q4 E-TRON SPORTBACK', 'derivative': '125kW 35 55kWh S Line 5dr Auto [C+S/Tech Pack]', 'mileage': 31261, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-19', 'fuel': 'Electric', 'motExpiry': None, 'doors': 5, 'engineSize': None, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/SW72AXC/2025-11-12/image/deb100a6-51d5-434c-b91e-983a70e14481_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/b4d35349-a948-421c-aa65-b4219b1c72b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/7247d9ae-3e21-4778-92be-2efbef26ad89_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/4d142f87-0c89-4a2e-9cfd-b15f0a521ccf_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/15ce1493-aecd-48c4-b0e2-f1824aa0da04_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/e571ddeb-bdcc-45ee-a097-aa747249734f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/27c26cd8-b9b3-41bd-94ee-8a32f9a70034_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/3d7b72e6-319f-4623-91e4-f994ea2eb096_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW72AXC/2025-11-12/image/d41dcde1-358d-4400-91ee-356352d3cfb3_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 11/24- 20K,', 'remarks': '**287**', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce563600-1e83-4ac1-923c-33bcf08b9c98.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a01b06e-d171-52bd-bd83-9f930ceb2488 with identifier: 117140308
2025-12-04 19:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a01b06e-d171-52bd-bd83-9f930ceb2488 with scrape type 2
2025-12-04 19:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a01b06e-d171-52bd-bd83-9f930ceb2488 with scrape type 2
2025-12-04 19:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a01b06e-d171-52bd-bd83-9f930ceb2488, identifier: 117140308
2025-12-04 19:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67cf49ea-a185-5717-9f82-44481b4967c7 with identifier: 117242944
2025-12-04 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67cf49ea-a185-5717-9f82-44481b4967c7 with identifier: 117242944
2025-12-04 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'fiat 500 electric hatchback 87kw icon 42kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'fiat', 'model': '500 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4828, 'odometer_reading_unit': 'mi', 'registration_date': '2022-07-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242944', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '87kw icon 42kwh 3dr auto', 'license_plate': 'vk22wkw', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '67cf49ea-a185-5717-9f82-44481b4967c7', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'fiat 500 electric hatchback', 'sanitized_make': 'fiat', 'odometer_in_km': 7769} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 40,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '67cf49ea-a185-5717-9f82-44481b4967c7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vk22wkw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242944',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'fiat',
     'make_model': 'fiat 500 electric hatchback',
     'model': '500 electric hatchback',
     'odometer': 4828,
     'odometer_in_km': 7769,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-07-25',
     'sanitized_make': 'fiat',
     'seller_name': 'kinto',
     'title': 'fiat 500 electric hatchback 87kw icon 42kwh 3dr auto',
     'transmission': 'automatic',
     'trim': '87kw icon 42kwh 3dr auto',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 67cf49ea-a185-5717-9f82-44481b4967c7 spider: astonbarclay.gb
2025-12-04 19:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 67cf49ea-a185-5717-9f82-44481b4967c7 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'fiat 500 electric hatchback 87kw icon 42kwh 3dr auto', 'price': 0, 'currency': 'gbp', 'make': 'fiat', 'model': '500 electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 4828, 'odometer_reading_unit': 'mi', 'registration_date': '2022-07-25', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242944', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '87kw icon 42kwh 3dr auto', 'license_plate': 'vk22wkw', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 3, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '67cf49ea-a185-5717-9f82-44481b4967c7', 'current_year_diff': 3, 'age_in_months': 40, 'make_model': 'fiat 500 electric hatchback', 'sanitized_make': 'fiat', 'odometer_in_km': 7769} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 40,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 3,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '67cf49ea-a185-5717-9f82-44481b4967c7',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'vk22wkw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242944',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'fiat',
     'make_model': 'fiat 500 electric hatchback',
     'model': '500 electric hatchback',
     'odometer': 4828,
     'odometer_in_km': 7769,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-07-25',
     'sanitized_make': 'fiat',
     'seller_name': 'kinto',
     'title': 'fiat 500 electric hatchback 87kw icon 42kwh 3dr auto',
     'transmission': 'automatic',
     'trim': '87kw icon 42kwh 3dr auto',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '67cf49ea-a185-5717-9f82-44481b4967c7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'VK22WKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117242944',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FIAT',
 'model': '500 ELECTRIC HATCHBACK',
 'odometer': 4828,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-25',
 'seller_name': 'Kinto',
 'title': 'FIAT 500 ELECTRIC HATCHBACK 87kW Icon 42kWh 3dr Auto',
 'transmission': 'automatic',
 'trim': '87kW Icon 42kWh 3dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117242944%27 HTTP/1.1" 200 None
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Saving data for 117242944: {'auction_closing_time': 1765532700.0, 'created_time': 1763751869.175774, 'last_price_update_time': 1764874952.046474}
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117242944') HTTP/1.1" 204 0
2025-12-04 19:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a01b06e-d171-52bd-bd83-9f930ceb2488 with identifier: 117140308
2025-12-04 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a01b06e-d171-52bd-bd83-9f930ceb2488 with identifier: 117140308
2025-12-04 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback 125kw 35 55kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 31261, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140308', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '125kw 35 55kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'sw72axc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4a01b06e-d171-52bd-bd83-9f930ceb2488', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'audi q4 e-tron sportback', 'sanitized_make': 'audi', 'odometer_in_km': 50309} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '4a01b06e-d171-52bd-bd83-9f930ceb2488',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sw72axc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140308',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron sportback',
     'model': 'q4 e-tron sportback',
     'odometer': 31261,
     'odometer_in_km': 50309,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-19',
     'sanitized_make': 'audi',
     'seller_name': 'kinto',
     'title': 'audi q4 e-tron sportback 125kw 35 55kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '125kw 35 55kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2022}
2025-12-04 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4a01b06e-d171-52bd-bd83-9f930ceb2488 spider: astonbarclay.gb
2025-12-04 19:02:32 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4a01b06e-d171-52bd-bd83-9f930ceb2488 due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'kinto', 'price_includes_vat': False, 'title': 'audi q4 e-tron sportback 125kw 35 55kwh s line 5dr auto [c+s/tech pack]', 'price': 0, 'currency': 'gbp', 'make': 'audi', 'model': 'q4 e-tron sportback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 31261, 'odometer_reading_unit': 'mi', 'registration_date': '2022-12-19', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140308', 'expiration_date': '2025-12-12t09:45:00z', 'location': 'aston barclay wakefield', 'origin_country_code': 'gb', 'trim': '125kw 35 55kwh s line 5dr auto [c+s/tech pack]', 'license_plate': 'sw72axc', 'year': 2022, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4a01b06e-d171-52bd-bd83-9f930ceb2488', 'current_year_diff': 3, 'age_in_months': 35, 'make_model': 'audi q4 e-tron sportback', 'sanitized_make': 'audi', 'odometer_in_km': 50309} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 35,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 3,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-12t09:45:00z',
     'fuel_type': 'electric',
     'id': '4a01b06e-d171-52bd-bd83-9f930ceb2488',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'sw72axc',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140308',
     'listing': 'auction',
     'location': 'aston barclay wakefield',
     'make': 'audi',
     'make_model': 'audi q4 e-tron sportback',
     'model': 'q4 e-tron sportback',
     'odometer': 31261,
     'odometer_in_km': 50309,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2022-12-19',
     'sanitized_make': 'audi',
     'seller_name': 'kinto',
     'title': 'audi q4 e-tron sportback 125kw 35 55kwh s line 5dr auto '
              '[c+s/tech pack]',
     'transmission': 'automatic',
     'trim': '125kw 35 55kwh s line 5dr auto [c+s/tech pack]',
     'vin': None,
     'year': 2022}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Electric',
 'id': '4a01b06e-d171-52bd-bd83-9f930ceb2488',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'SW72AXC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117140308',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'AUDI',
 'model': 'Q4 E-TRON SPORTBACK',
 'odometer': 31261,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-19',
 'seller_name': 'Kinto',
 'title': 'AUDI Q4 E-TRON SPORTBACK 125kW 35 55kWh S Line 5dr Auto [C+S/Tech '
          'Pack]',
 'transmission': 'automatic',
 'trim': '125kW 35 55kWh S Line 5dr Auto [C+S/Tech Pack]',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117140308%27 HTTP/1.1" 200 None
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Saving data for 117140308: {'auction_closing_time': 1765532700.0, 'created_time': 1763579009.983596, 'last_price_update_time': 1764874952.269465}
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117140308') HTTP/1.1" 204 0
2025-12-04 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117567350?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117118656?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117567350, 'registration': 'BM19OVT', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr', 'mileage': 23782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BM19OVT/2025-11-28/image/b9fd5d1d-deac-4da8-a9ad-1101120ae7a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/1509fb4e-783e-4ce3-8345-a83e3520c56d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/41f0bc02-99ae-48be-9882-abdc1d67cc84_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/5eb1a664-1555-4288-8b9f-92c00f56a5a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/6c0fd44d-990a-4163-b20a-f37a19df0817_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/8cb129dd-8f37-4b5b-bd35-71ff8749e1ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/ba429b34-7134-4f9c-958e-91b1965cd572_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/9a21f110-d99a-454e-adb3-cee19de9305f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/23-18K, 01/25-21K,', 'remarks': 'VOSA STATES 11K 15K 18K 21K, SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33f2de54-4116-4295-a9c7-ece518935ed2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117567350, 'registration': 'BM19OVT', 'account': 'RCI001', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T MH 158 N-Connecta 5dr', 'mileage': 23782, 'mileageWarranty': True, 'type': 'car', 'saleId': 17975, 'siteId': 20846447, 'site': {'id': 20846447, 'name': 'Aston Barclay Donington Park', 'vehicles': 155}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-21', 'fuel': 'Petrol', 'motExpiry': '2026-01-13', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BM19OVT/2025-11-28/image/b9fd5d1d-deac-4da8-a9ad-1101120ae7a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/1509fb4e-783e-4ce3-8345-a83e3520c56d_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/41f0bc02-99ae-48be-9882-abdc1d67cc84_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/5eb1a664-1555-4288-8b9f-92c00f56a5a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/6c0fd44d-990a-4163-b20a-f37a19df0817_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/8cb129dd-8f37-4b5b-bd35-71ff8749e1ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/ba429b34-7134-4f9c-958e-91b1965cd572_removebg.jpg?w=600', 'https://abimg003.imgix.net/BM19OVT/2025-11-28/image/9a21f110-d99a-454e-adb3-cee19de9305f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 12/23-18K, 01/25-21K,', 'remarks': 'VOSA STATES 11K 15K 18K 21K, SPARE KEY', 'virtual': False, 'seller': 'Mobilize Financial Services', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/33f2de54-4116-4295-a9c7-ece518935ed2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-12-04 19:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with scrape type 2
2025-12-04 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with scrape type 2
2025-12-04 19:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360, identifier: 117567350
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117118656, 'registration': 'RE22UMJ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 29085, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-06', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/d5c30120-fb01-4f5f-8244-ee7071744c79_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/5f7776e0-5c87-4564-9a0e-7ba87039a350_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/346addd0-d656-44b6-b55c-5942824cdffd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/355f5d3f-8a11-4621-8ccb-6e829a13021c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/85747c2b-3071-4bd4-a7fe-07cd327084c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/5686892a-2c83-4c03-bed2-9c6e50b1fad4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/36050da2-8807-42c5-9d0f-fdc7960fd2d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/f5dc962c-14da-4ab9-b128-6a065ad40eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/cffcf545-e194-42ae-9678-4f499337ec47_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**228** VOSA STATES 24K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a578b1c3-5f83-4088-89c1-de6498eeb704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117118656, 'registration': 'RE22UMJ', 'account': 'KIN032', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI Life 5dr', 'mileage': 29085, 'mileageWarranty': True, 'type': 'car', 'saleId': 17903, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-12T09:45Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-05-17', 'fuel': 'Petrol', 'motExpiry': '2026-04-06', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/d5c30120-fb01-4f5f-8244-ee7071744c79_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/5f7776e0-5c87-4564-9a0e-7ba87039a350_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/346addd0-d656-44b6-b55c-5942824cdffd_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/355f5d3f-8a11-4621-8ccb-6e829a13021c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/85747c2b-3071-4bd4-a7fe-07cd327084c1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/5686892a-2c83-4c03-bed2-9c6e50b1fad4_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/36050da2-8807-42c5-9d0f-fdc7960fd2d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/f5dc962c-14da-4ab9-b128-6a065ad40eb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/RE22UMJ/2025-11-11/image/cffcf545-e194-42ae-9678-4f499337ec47_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '(NO SERVICE HISTORY)', 'remarks': '**228** VOSA STATES 24K SPARE KEY', 'virtual': False, 'seller': 'Kinto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a578b1c3-5f83-4088-89c1-de6498eeb704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with identifier: 117118656
2025-12-04 19:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with scrape type 2
2025-12-04 19:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with scrape type 2
2025-12-04 19:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7c09d532-b61f-5775-8dbc-4a0f457f0f7b, identifier: 117118656
2025-12-04 19:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-12-04 19:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350
2025-12-04 19:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360 with identifier: 117567350 to the API
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2772cf6b33-bfe0-56fd-8273-2d0c6dd7c360%27 HTTP/1.1" 200 None
2025-12-04 19:02:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 72cf6b33-bfe0-56fd-8273-2d0c6dd7c360: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117567350?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '72cf6b33-bfe0-56fd-8273-2d0c6dd7c360',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BM19OVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117567350',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 23782,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-21',
 'seller_name': 'Mobilize Financial Services',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T MH 158 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T MH 158 N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117567350%27 HTTP/1.1" 200 None
2025-12-04 19:02:32 [astonbarclay.gb] INFO: Saving data for 117567350: {'auction_closing_time': 1765447200.0, 'created_time': 1764270379.836642, 'last_price_update_time': 1764874952.973719}
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117567350') HTTP/1.1" 204 0
2025-12-04 19:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with identifier: 117118656
2025-12-04 19:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with identifier: 117118656
2025-12-04 19:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7c09d532-b61f-5775-8dbc-4a0f457f0f7b with identifier: 117118656 to the API
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117118656?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-12T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7c09d532-b61f-5775-8dbc-4a0f457f0f7b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'RE22UMJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117118656',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 29085,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-17',
 'seller_name': 'Kinto',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI Life 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117118656%27 HTTP/1.1" 200 None
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Saving data for 117118656: {'auction_closing_time': 1765532700.0, 'created_time': 1763579018.12077, 'last_price_update_time': 1764874953.296264}
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117118656') HTTP/1.1" 204 0
2025-12-04 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117763810?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117763810, 'registration': 'MF19DJE', 'account': 'AFF012', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr EAT6', 'mileage': 66882, 'mileageWarranty': False, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 38K 80K 58K 64K 66K VOSA DISCREPANCY', 'virtual': False, 'seller': 'Affordable Car Finance NW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117763810, 'registration': 'MF19DJE', 'account': 'AFF012', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 110 Flair 5dr EAT6', 'mileage': 66882, 'mileageWarranty': False, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-03-26', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 38K 80K 58K 64K 66K VOSA DISCREPANCY', 'virtual': False, 'seller': 'Affordable Car Finance NW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ae49036e-a81c-5a34-a65e-11c56b148086 with identifier: 117763810
2025-12-04 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ae49036e-a81c-5a34-a65e-11c56b148086 with scrape type 1
2025-12-04 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item ae49036e-a81c-5a34-a65e-11c56b148086
2025-12-04 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item ae49036e-a81c-5a34-a65e-11c56b148086
2025-12-04 19:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ae49036e-a81c-5a34-a65e-11c56b148086, identifier: 117763810
2025-12-04 19:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ae49036e-a81c-5a34-a65e-11c56b148086 with identifier: 117763810
2025-12-04 19:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ae49036e-a81c-5a34-a65e-11c56b148086 with identifier: 117763810
2025-12-04 19:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ae49036e-a81c-5a34-a65e-11c56b148086 with identifier: 117763810 to the API
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27ae49036e-a81c-5a34-a65e-11c56b148086%27 HTTP/1.1" 200 None
2025-12-04 19:02:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id ae49036e-a81c-5a34-a65e-11c56b148086: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117763810?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ae49036e-a81c-5a34-a65e-11c56b148086',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MF19DJE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763810',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 66882,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-26',
 'seller_name': 'Affordable Car Finance NW',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 110 Flair 5dr EAT6',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 110 Flair 5dr EAT6',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763810%27 HTTP/1.1" 200 None
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Saving data for 117763810: {'created_time': 1764874953.791158, 'last_price_update_time': 1764874953.791169, 'auction_closing_time': 1765447200.0}
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117763810') HTTP/1.1" 204 0
2025-12-04 19:02:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117495107?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117495107, 'registration': 'SA71WDU', 'account': 'ARN084', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 9327, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-13', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is rear end and vandalism vosa@ 1k, 5k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:33 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117495107, 'registration': 'SA71WDU', 'account': 'ARN084', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 9327, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2021-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-04-13', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': 'Cat S Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'Category S Insurance Loss. Vehicle Structurally Damaged But Repairable-Insurer Decided Not to Repair CAT S - STRUCTURAL - Damage is rear end and vandalism vosa@ 1k, 5k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 135, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c98734d-d621-560b-ba20-d578e4cc279b with identifier: 117495107
2025-12-04 19:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c98734d-d621-560b-ba20-d578e4cc279b with scrape type 2
2025-12-04 19:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c98734d-d621-560b-ba20-d578e4cc279b with scrape type 2
2025-12-04 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0c98734d-d621-560b-ba20-d578e4cc279b, identifier: 117495107
2025-12-04 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0c98734d-d621-560b-ba20-d578e4cc279b with identifier: 117495107
2025-12-04 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0c98734d-d621-560b-ba20-d578e4cc279b with identifier: 117495107
2025-12-04 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0c98734d-d621-560b-ba20-d578e4cc279b with identifier: 117495107 to the API
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270c98734d-d621-560b-ba20-d578e4cc279b%27 HTTP/1.1" 200 None
2025-12-04 19:02:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0c98734d-d621-560b-ba20-d578e4cc279b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117495107?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 135,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0c98734d-d621-560b-ba20-d578e4cc279b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SA71WDU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117495107',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 9327,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-30',
 'seller_name': 'Arnold Clark',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495107%27 HTTP/1.1" 200 None
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Saving data for 117495107: {'auction_closing_time': 1765447200.0, 'created_time': 1764097556.895735, 'last_price_update_time': 1764874954.328891}
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117495107') HTTP/1.1" 204 0
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116377459?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117768376?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117495072?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117495054?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116377459, 'registration': 'YN22UBF', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Premium 5dr Tip Auto', 'mileage': 33224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN22UBF/2025-10-15/image/581da0e2-6014-4a34-b205-6ac52121d56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/f6401829-5971-41c1-8371-8ee88f156ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/cd75b584-e8bd-4895-965e-dfbbed0b255d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/77f4e35d-8bab-43f9-825f-b56877343d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/3d89823f-5165-444d-bd6d-9acae49d0269_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/634d1bc8-c3c6-44eb-a281-2d1028374f49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fdb19e15-215a-4604-bde7-1786df39b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fe86b970-ce11-4ff0-b9cb-4a044472a1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/267e5f94-3a6e-45a8-83ca-d36a0cb4bb6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 03/25 31K', 'remarks': 'VOSA STATES, 31K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bbac135-a147-49b8-9b55-dbfc588e4f46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116377459, 'registration': 'YN22UBF', 'account': 'GAT023', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 200 AMG Line Premium 5dr Tip Auto', 'mileage': 33224, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-03-29', 'fuel': 'Petrol', 'motExpiry': '2026-03-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN22UBF/2025-10-15/image/581da0e2-6014-4a34-b205-6ac52121d56e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/f6401829-5971-41c1-8371-8ee88f156ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/cd75b584-e8bd-4895-965e-dfbbed0b255d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/77f4e35d-8bab-43f9-825f-b56877343d71_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/3d89823f-5165-444d-bd6d-9acae49d0269_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/634d1bc8-c3c6-44eb-a281-2d1028374f49_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fdb19e15-215a-4604-bde7-1786df39b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/fe86b970-ce11-4ff0-b9cb-4a044472a1dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN22UBF/2025-10-15/image/267e5f94-3a6e-45a8-83ca-d36a0cb4bb6f_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service print 03/25 31K', 'remarks': 'VOSA STATES, 31K', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 141, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1bbac135-a147-49b8-9b55-dbfc588e4f46.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-04 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c4fb1890-db3b-5070-a865-7abec315cd47 with scrape type 2
2025-12-04 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c4fb1890-db3b-5070-a865-7abec315cd47 with scrape type 2
2025-12-04 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c4fb1890-db3b-5070-a865-7abec315cd47, identifier: 116377459
2025-12-04 19:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-04 19:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459
2025-12-04 19:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c4fb1890-db3b-5070-a865-7abec315cd47 with identifier: 116377459 to the API
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27c4fb1890-db3b-5070-a865-7abec315cd47%27 HTTP/1.1" 200 None
2025-12-04 19:02:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id c4fb1890-db3b-5070-a865-7abec315cd47: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:33 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116377459?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c4fb1890-db3b-5070-a865-7abec315cd47',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YN22UBF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116377459',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 33224,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-03-29',
 'seller_name': 'Gates Group',
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE CLA 200 AMG Line Premium 5dr Tip '
          'Auto',
 'transmission': 'automatic',
 'trim': 'CLA 200 AMG Line Premium 5dr Tip Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116377459%27 HTTP/1.1" 200 None
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Saving data for 116377459: {'auction_closing_time': 1765360800.0, 'created_time': 1760511678.538537, 'last_price_update_time': 1764874954.830915}
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116377459') HTTP/1.1" 204 0
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116859641?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117768376, 'registration': 'EA18ZNH', 'account': 'ARN120', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 5dr', 'mileage': 45935, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-04-08', 'doors': 5, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 14k, 19k, 22k, 24k, 38k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117768376, 'registration': 'EA18ZNH', 'account': 'ARN120', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.1 Zetec 5dr', 'mileage': 45935, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-29', 'fuel': 'Petrol', 'motExpiry': '2026-04-08', 'doors': 5, 'engineSize': 1084, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'VOSA@ 14k, 19k, 22k, 24k, 38k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90f5f286-3d4e-569d-9800-cb58e8e1d4b5 with identifier: 117768376
2025-12-04 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90f5f286-3d4e-569d-9800-cb58e8e1d4b5 with scrape type 1
2025-12-04 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 90f5f286-3d4e-569d-9800-cb58e8e1d4b5
2025-12-04 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 90f5f286-3d4e-569d-9800-cb58e8e1d4b5
2025-12-04 19:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 90f5f286-3d4e-569d-9800-cb58e8e1d4b5, identifier: 117768376
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117495072, 'registration': 'YB19GEJ', 'account': 'ARN056', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Classic II 5dr', 'mileage': 93373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 44k, 58k, 72k, 89k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117495072, 'registration': 'YB19GEJ', 'account': 'ARN056', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Classic II 5dr', 'mileage': 93373, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-05-16', 'fuel': 'Petrol', 'motExpiry': '2026-07-21', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 44k, 58k, 72k, 89k,', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0921145e-ddca-5e0b-90cc-fb47ca6e8921 with identifier: 117495072
2025-12-04 19:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0921145e-ddca-5e0b-90cc-fb47ca6e8921 with scrape type 2
2025-12-04 19:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0921145e-ddca-5e0b-90cc-fb47ca6e8921 with scrape type 2
2025-12-04 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0921145e-ddca-5e0b-90cc-fb47ca6e8921, identifier: 117495072
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117495054, 'registration': 'ST69UEZ', 'account': 'ARN163', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Classic II 5dr', 'mileage': 92600, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-20', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 30k, 53k, 75k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117495054, 'registration': 'ST69UEZ', 'account': 'ARN163', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper Classic II 5dr', 'mileage': 92600, 'mileageWarranty': True, 'type': 'car', 'saleId': 17793, 'siteId': 659779, 'site': {'id': 659779, 'name': 'Aston Barclay Prees Heath', 'vehicles': 101}, 'saleStart': '2025-12-11T10:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-12-20', 'fuel': 'Petrol', 'motExpiry': '2025-12-19', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': None, 'colour': 'ORANGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'vosa@ 30k, 53k, 75k', 'virtual': False, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d39bbea-b20b-5502-aeb0-b8729417186a with identifier: 117495054
2025-12-04 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d39bbea-b20b-5502-aeb0-b8729417186a with scrape type 2
2025-12-04 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d39bbea-b20b-5502-aeb0-b8729417186a with scrape type 2
2025-12-04 19:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8d39bbea-b20b-5502-aeb0-b8729417186a, identifier: 117495054
2025-12-04 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117704311?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 90f5f286-3d4e-569d-9800-cb58e8e1d4b5 with identifier: 117768376
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 90f5f286-3d4e-569d-9800-cb58e8e1d4b5 with identifier: 117768376
2025-12-04 19:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 90f5f286-3d4e-569d-9800-cb58e8e1d4b5 with identifier: 117768376 to the API
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2790f5f286-3d4e-569d-9800-cb58e8e1d4b5%27 HTTP/1.1" 200 None
2025-12-04 19:02:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 90f5f286-3d4e-569d-9800-cb58e8e1d4b5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117768376?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.1L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '90f5f286-3d4e-569d-9800-cb58e8e1d4b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA18ZNH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117768376',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 45935,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-29',
 'seller_name': 'Arnold Clark',
 'title': 'FORD FIESTA HATCHBACK 1.1 Zetec 5dr',
 'transmission': 'manual',
 'trim': '1.1 Zetec 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117768376%27 HTTP/1.1" 200 None
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Saving data for 117768376: {'created_time': 1764874955.394458, 'last_price_update_time': 1764874955.394469, 'auction_closing_time': 1765447200.0}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117768376') HTTP/1.1" 204 0
2025-12-04 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0921145e-ddca-5e0b-90cc-fb47ca6e8921 with identifier: 117495072
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0921145e-ddca-5e0b-90cc-fb47ca6e8921 with identifier: 117495072
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150268 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150268
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 0921145e-ddca-5e0b-90cc-fb47ca6e8921 spider: astonbarclay.gb
2025-12-04 19:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 0921145e-ddca-5e0b-90cc-fb47ca6e8921 due to rule: high_mileage_for_country.json, error: 150268 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150268
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0921145e-ddca-5e0b-90cc-fb47ca6e8921',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB19GEJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117495072',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 93373,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-16',
 'seller_name': 'Arnold Clark',
 'title': 'MINI HATCHBACK 1.5 Cooper Classic II 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper Classic II 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495072%27 HTTP/1.1" 200 None
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Saving data for 117495072: {'auction_closing_time': 1765447200.0, 'created_time': 1764097558.104095, 'last_price_update_time': 1764874955.618207}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117495072') HTTP/1.1" 204 0
2025-12-04 19:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8d39bbea-b20b-5502-aeb0-b8729417186a with identifier: 117495054
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8d39bbea-b20b-5502-aeb0-b8729417186a with identifier: 117495054
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 149024 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149024
2025-12-04 19:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8d39bbea-b20b-5502-aeb0-b8729417186a spider: astonbarclay.gb
2025-12-04 19:02:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8d39bbea-b20b-5502-aeb0-b8729417186a due to rule: high_mileage_for_make.json, error: 149024 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    149024
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-11T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '8d39bbea-b20b-5502-aeb0-b8729417186a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ST69UEZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117495054',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 92600,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-12-20',
 'seller_name': 'Arnold Clark',
 'title': 'MINI HATCHBACK 1.5 Cooper Classic II 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper Classic II 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117495054%27 HTTP/1.1" 200 None
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Saving data for 117495054: {'auction_closing_time': 1765447200.0, 'created_time': 1764097557.123659, 'last_price_update_time': 1764874955.839608}
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117495054') HTTP/1.1" 204 0
2025-12-04 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116859641, 'registration': 'HG22CHJ', 'account': 'GAT001', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT 5dr', 'mileage': 49401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/361fa3e5-8691-465d-9359-00a68a815db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/e0172f66-aaed-4c10-bf7c-4b360bc2f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/c1fda99d-be74-499f-abff-019191b8c5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/34b2b796-75f1-43d2-a688-aeb002b62ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/5407d368-107f-41db-b384-1ee315567be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/cabb3944-8d83-4adc-8403-f5ee2e67304f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/15fe5a1f-34ff-4c60-9a0c-26ade2e98586_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/522107b8-52f3-4c16-bd4c-513a60ce9430_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/f4748afb-52bf-4f0f-bd8a-7358a1e3bb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/9454b383-6f5c-4a1e-be00-a8e59548c382_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'UNABLE TO AA DUE TO BONNET RELEASE BEING BROKEN - PHOTOCOPY OF V5 IN OFFICE -', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7643179-91c6-4ad6-a0bc-18651584783a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:35 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116859641, 'registration': 'HG22CHJ', 'account': 'GAT001', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT 5dr', 'mileage': 49401, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2022-06-30', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/361fa3e5-8691-465d-9359-00a68a815db9_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/e0172f66-aaed-4c10-bf7c-4b360bc2f58e_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/c1fda99d-be74-499f-abff-019191b8c5de_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/34b2b796-75f1-43d2-a688-aeb002b62ad6_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/5407d368-107f-41db-b384-1ee315567be7_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/cabb3944-8d83-4adc-8403-f5ee2e67304f_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/15fe5a1f-34ff-4c60-9a0c-26ade2e98586_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/522107b8-52f3-4c16-bd4c-513a60ce9430_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/f4748afb-52bf-4f0f-bd8a-7358a1e3bb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/HG22CHJ/2025-11-04/image/9454b383-6f5c-4a1e-be00-a8e59548c382_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'UNABLE TO AA DUE TO BONNET RELEASE BEING BROKEN - PHOTOCOPY OF V5 IN OFFICE -', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e7643179-91c6-4ad6-a0bc-18651584783a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-04 19:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 60a9051e-2fed-56bb-8402-520d9f3f47d1 with scrape type 2
2025-12-04 19:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 60a9051e-2fed-56bb-8402-520d9f3f47d1 with scrape type 2
2025-12-04 19:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 60a9051e-2fed-56bb-8402-520d9f3f47d1, identifier: 116859641
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117737357, 'registration': 'KM18HHW', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Active 5dr', 'mileage': 26163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-01', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/19- 18K', 'remarks': 'VOSA STATES 22K, 23K, 24K, 26K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ccd98abb-e68a-45c0-8cbe-4d2632a12c4e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117737357, 'registration': 'KM18HHW', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '2008 ESTATE', 'derivative': '1.2 PureTech Active 5dr', 'mileage': 26163, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-05-01', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/19- 18K', 'remarks': 'VOSA STATES 22K, 23K, 24K, 26K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ccd98abb-e68a-45c0-8cbe-4d2632a12c4e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88b514d5-1b15-5a73-be3a-1082c27ed7de with identifier: 117737357
2025-12-04 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b514d5-1b15-5a73-be3a-1082c27ed7de with scrape type 1
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fb228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117704311, 'registration': 'OE69BWV', 'account': 'STE009', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d AMG Line Executive 5dr Auto', 'mileage': 60960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-18', 'fuel': 'Diesel', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600', 'https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600', 'https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600', 'https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f64c4809-797c-4244-a777-369bf855bc9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117704311, 'registration': 'OE69BWV', 'account': 'STE009', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d AMG Line Executive 5dr Auto', 'mileage': 60960, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-11-18', 'fuel': 'Diesel', 'motExpiry': '2026-11-25', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600', 'https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600', 'https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600', 'https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service print', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f64c4809-797c-4244-a777-369bf855bc9d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb31c3cb-594b-5edf-b5bd-55cff562a335 with identifier: 117704311
2025-12-04 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb31c3cb-594b-5edf-b5bd-55cff562a335 with scrape type 1
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item eb31c3cb-594b-5edf-b5bd-55cff562a335
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-04 19:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641
2025-12-04 19:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 60a9051e-2fed-56bb-8402-520d9f3f47d1 with identifier: 116859641 to the API
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116859641?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '60a9051e-2fed-56bb-8402-520d9f3f47d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'HG22CHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116859641',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 49401,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-06-30',
 'seller_name': 'Gates Group',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 100 GT 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 GT 5dr',
 'vin': None,
 'year': 2022}
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116859641%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Saving data for 116859641: {'auction_closing_time': 1765360800.0, 'created_time': 1762283179.526065, 'last_price_update_time': 1764874956.681109}
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116859641') HTTP/1.1" 204 0
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ffb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117590193?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116674717?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117710027?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc18955a3-e367-4114-8a96-10a6b17dd372.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117736230, 'registration': 'MV68WXD', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 31971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 9K, 15K, 22K, 30K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a94c779-f110-4f59-8c00-77847c2b7395.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117736230, 'registration': 'MV68WXD', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost 125 Titanium 5dr', 'mileage': 31971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-09-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-05', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES 9K, 15K, 22K, 30K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/1a94c779-f110-4f59-8c00-77847c2b7395.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fa49bae2-8766-5df8-bf24-191d97be56e8 with identifier: 117736230
2025-12-04 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa49bae2-8766-5df8-bf24-191d97be56e8 with scrape type 1
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ff96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb5568abe-84b7-4d96-8fed-0f42de1984eb.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fe1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117590193, 'registration': 'EJ70BNY', 'account': 'GAT001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 46788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/b412ccbc-8bdd-4931-a94b-64cb59fc2c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/90ac871c-cde3-4283-9f14-db3859ef7ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f6b3b8da-36dc-4c85-9d1a-98791179d608_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5a7aca90-55ca-4d49-bfd1-383483da3ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f1f131e1-6d0d-4da6-ac54-97e7b81fa7b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5bb38f17-444b-4118-bdc1-c88272c2fc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/47bf0419-269a-4298-8dbd-448a2ef33a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/6f407f84-9808-417e-96a9-d429e9350800_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/2e7ff08e-99c3-49d6-9510-4a7ca6081a3a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 22K, 32K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60856e58-650f-4ec3-8043-47bfc6ac88cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117590193, 'registration': 'EJ70BNY', 'account': 'GAT001', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr', 'mileage': 46788, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-12-10', 'fuel': 'Petrol', 'motExpiry': '2026-10-05', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/b412ccbc-8bdd-4931-a94b-64cb59fc2c7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/90ac871c-cde3-4283-9f14-db3859ef7ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f6b3b8da-36dc-4c85-9d1a-98791179d608_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5a7aca90-55ca-4d49-bfd1-383483da3ee2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/f1f131e1-6d0d-4da6-ac54-97e7b81fa7b7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/5bb38f17-444b-4118-bdc1-c88272c2fc0a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/47bf0419-269a-4298-8dbd-448a2ef33a83_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/6f407f84-9808-417e-96a9-d429e9350800_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ70BNY/2025-12-01/image/2e7ff08e-99c3-49d6-9510-4a7ca6081a3a_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 22K, 32K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/60856e58-650f-4ec3-8043-47bfc6ac88cd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-04 19:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d779f7d-23f1-5eab-ae80-24405f2c959b with scrape type 2
2025-12-04 19:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d779f7d-23f1-5eab-ae80-24405f2c959b with scrape type 2
2025-12-04 19:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d779f7d-23f1-5eab-ae80-24405f2c959b, identifier: 117590193
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116674717, 'registration': 'EA72XPU', 'account': 'GAT019', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 5dr', 'mileage': 14869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-02-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72XPU/2025-10-27/image/6d59ce6b-a42a-44d4-9d51-1f493e848d69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/c944c0af-5518-410c-8490-c5d8dfc1c71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/1639dcda-1691-4a9f-bdfb-85da0681ef7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/7d5878b7-a1d5-4a80-8583-d353a2866fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/062af1ee-8570-4b86-b625-aa7aa96e6831_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/fbc6a3c3-fbb3-40da-8044-8145a6c30fbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/30363d9c-7b98-458f-b565-6b9620534bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/d764efcc-9bfd-45d8-8ab1-e4ec0bdebb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/05d532d4-883f-4352-a83c-3b808e40b00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/0ed9e36e-66ee-48d6-9f30-b53d511cc8ed_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad1540df-89e7-4422-841d-614ca3154249.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116674717, 'registration': 'EA72XPU', 'account': 'GAT019', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost ST-Line 5dr', 'mileage': 14869, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-02-24', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA72XPU/2025-10-27/image/6d59ce6b-a42a-44d4-9d51-1f493e848d69_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/c944c0af-5518-410c-8490-c5d8dfc1c71b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/1639dcda-1691-4a9f-bdfb-85da0681ef7e_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/7d5878b7-a1d5-4a80-8583-d353a2866fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/062af1ee-8570-4b86-b625-aa7aa96e6831_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/fbc6a3c3-fbb3-40da-8044-8145a6c30fbd_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/30363d9c-7b98-458f-b565-6b9620534bf3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/d764efcc-9bfd-45d8-8ab1-e4ec0bdebb48_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/05d532d4-883f-4352-a83c-3b808e40b00a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA72XPU/2025-10-27/image/0ed9e36e-66ee-48d6-9f30-b53d511cc8ed_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ad1540df-89e7-4422-841d-614ca3154249.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-04 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 900535d2-2611-5814-b900-1bb4692d1313 with scrape type 2
2025-12-04 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 900535d2-2611-5814-b900-1bb4692d1313 with scrape type 2
2025-12-04 19:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 900535d2-2611-5814-b900-1bb4692d1313, identifier: 116674717
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117710027, 'registration': 'BV69ZXM', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 21476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-12-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117710027, 'registration': 'BV69ZXM', 'account': 'WBA002', 'make': 'MG MOTOR UK', 'model': 'ZS HATCHBACK', 'derivative': '1.0T GDi Exclusive 5dr DCT', 'mileage': 21476, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2019-10-31', 'fuel': 'Petrol', 'motExpiry': '2026-12-07', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08976e21-4716-5695-ac6e-7fa99da485d0 with identifier: 117710027
2025-12-04 19:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08976e21-4716-5695-ac6e-7fa99da485d0 with scrape type 1
2025-12-04 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 08976e21-4716-5695-ac6e-7fa99da485d0
2025-12-04 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 08976e21-4716-5695-ac6e-7fa99da485d0
2025-12-04 19:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08976e21-4716-5695-ac6e-7fa99da485d0, identifier: 117710027
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Ff7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-04 19:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193
2025-12-04 19:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d779f7d-23f1-5eab-ae80-24405f2c959b with identifier: 117590193 to the API
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270d779f7d-23f1-5eab-ae80-24405f2c959b%27 HTTP/1.1" 200 None
2025-12-04 19:02:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d779f7d-23f1-5eab-ae80-24405f2c959b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:36 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117590193?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d779f7d-23f1-5eab-ae80-24405f2c959b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ70BNY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117590193',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 46788,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-10',
 'seller_name': 'Gates Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV ST-Line 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117590193%27 HTTP/1.1" 200 None
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Saving data for 117590193: {'auction_closing_time': 1765360800.0, 'created_time': 1764356622.175458, 'last_price_update_time': 1764874957.586131}
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117590193') HTTP/1.1" 204 0
2025-12-04 19:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-04 19:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717
2025-12-04 19:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 900535d2-2611-5814-b900-1bb4692d1313 with identifier: 116674717 to the API
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27900535d2-2611-5814-b900-1bb4692d1313%27 HTTP/1.1" 200 None
2025-12-04 19:02:37 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 900535d2-2611-5814-b900-1bb4692d1313: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116674717?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '900535d2-2611-5814-b900-1bb4692d1313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA72XPU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116674717',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 14869,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-24',
 'seller_name': 'Gates Group',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost ST-Line 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost ST-Line 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116674717%27 HTTP/1.1" 200 None
2025-12-04 19:02:37 [astonbarclay.gb] INFO: Saving data for 116674717: {'auction_closing_time': 1765360800.0, 'created_time': 1761332486.83566, 'last_price_update_time': 1764874957.892795}
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116674717') HTTP/1.1" 204 0
2025-12-04 19:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08976e21-4716-5695-ac6e-7fa99da485d0 with identifier: 117710027
2025-12-04 19:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08976e21-4716-5695-ac6e-7fa99da485d0 with identifier: 117710027
2025-12-04 19:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 08976e21-4716-5695-ac6e-7fa99da485d0 with identifier: 117710027 to the API
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2708976e21-4716-5695-ac6e-7fa99da485d0%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 08976e21-4716-5695-ac6e-7fa99da485d0: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:37 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117710027?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '08976e21-4716-5695-ac6e-7fa99da485d0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BV69ZXM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117710027',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'ZS HATCHBACK',
 'odometer': 21476,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'MG MOTOR UK ZS HATCHBACK 1.0T GDi Exclusive 5dr DCT',
 'transmission': 'automatic',
 'trim': '1.0T GDi Exclusive 5dr DCT',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117710027%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Saving data for 117710027: {'created_time': 1764874958.19063, 'last_price_update_time': 1764874958.19064, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117710027') HTTP/1.1" 204 0
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fbd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117739170, 'registration': 'EA18XUR', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '308 HATCHBACK', 'derivative': '1.6 THP 205 GT 5dr', 'mileage': 50332, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/21- 12K, 07/22- ??, 07/23- 25K, 09/24- 32K', 'remarks': 'VOSA STATES 19K, 24K, 30K, 36K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a5c30e1-a28f-4d00-9b4c-e94c03981bbf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117739170, 'registration': 'EA18XUR', 'account': 'WBA002', 'make': 'PEUGEOT', 'model': '308 HATCHBACK', 'derivative': '1.6 THP 205 GT 5dr', 'mileage': 50332, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/21- 12K, 07/22- ??, 07/23- 25K, 09/24- 32K', 'remarks': 'VOSA STATES 19K, 24K, 30K, 36K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9a5c30e1-a28f-4d00-9b4c-e94c03981bbf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f724f2eb-fa20-5e48-9acb-570d94f24af0 with identifier: 117739170
2025-12-04 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f724f2eb-fa20-5e48-9acb-570d94f24af0 with scrape type 1
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a67510>
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fb228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ff272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117708761?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd68a67d0>
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ffb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117702574, 'registration': 'BG68VTL', 'account': 'MER178', 'make': 'JAGUAR', 'model': 'XE SALOON', 'derivative': '2.0 Ingenium R-Sport 4dr Auto', 'mileage': 46464, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-10', 'doors': 4, 'engineSize': 1997, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600', 'https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600', 'https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600', 'https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600', 'https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600', 'https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600', 'https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600', 'https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600', 'https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service book', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117702574, 'registration': 'BG68VTL', 'account': 'MER178', 'make': 'JAGUAR', 'model': 'XE SALOON', 'derivative': '2.0 Ingenium R-Sport 4dr Auto', 'mileage': 46464, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-10-11', 'fuel': 'Petrol', 'motExpiry': '2026-10-10', 'doors': 4, 'engineSize': 1997, 'bodyType': 'Saloon', 'images': ['https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600', 'https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600', 'https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600', 'https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600', 'https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600', 'https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600', 'https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600', 'https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600', 'https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': 'Service book', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 165, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57e4ad75-9f0f-5400-884e-065c779a06b9 with identifier: 117702574
2025-12-04 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e4ad75-9f0f-5400-884e-065c779a06b9 with scrape type 1
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1c55774b-9a3d-42b4-92c5-5cd091211299.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600 not downloaded yet
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117704163, 'registration': 'LS22HFZ', 'account': 'STE009', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 eTSI 150 Life 5dr DSG', 'mileage': 27540, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-26', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600', 'https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600', 'https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600', 'https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600', 'https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600', 'https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600', 'https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600', 'https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600', 'https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff2fcf6e-9672-4a82-ad57-3418179cc740.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117704163, 'registration': 'LS22HFZ', 'account': 'STE009', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 eTSI 150 Life 5dr DSG', 'mileage': 27540, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-05-26', 'fuel': 'Petrol', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600', 'https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600', 'https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600', 'https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600', 'https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600', 'https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600', 'https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600', 'https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600', 'https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff2fcf6e-9672-4a82-ad57-3418179cc740.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f8e6d35-ec27-5748-a643-b500ac12e606 with identifier: 117704163
2025-12-04 19:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8e6d35-ec27-5748-a643-b500ac12e606 with scrape type 1
2025-12-04 19:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fcf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fb6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252Fb17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Ff5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Febcdef3c-4ce1-4ebf-9824-321c93658348.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252Fd893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704311?view=catalogue)
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F8eab3271-298b-44e0-b30b-0ce112354ee5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fc01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117708761, 'registration': 'YR17LGY', 'account': 'ALL022', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr', 'mileage': 96617, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-12-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705c45a8-be48-4480-8188-dfb25f1f85a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117708761, 'registration': 'YR17LGY', 'account': 'ALL022', 'make': 'FORD', 'model': 'S-MAX DIESEL ESTATE', 'derivative': '2.0 TDCi 180 Titanium 5dr', 'mileage': 96617, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-06-29', 'fuel': 'Diesel', 'motExpiry': '2026-12-01', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'SMC Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705c45a8-be48-4480-8188-dfb25f1f85a3.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f7627e89-a7b9-557e-a0a3-b1a107a52cf9 with identifier: 117708761
2025-12-04 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f7627e89-a7b9-557e-a0a3-b1a107a52cf9 with scrape type 1
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item f7627e89-a7b9-557e-a0a3-b1a107a52cf9
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item f7627e89-a7b9-557e-a0a3-b1a107a52cf9
2025-12-04 19:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f7627e89-a7b9-557e-a0a3-b1a107a52cf9, identifier: 117708761
2025-12-04 19:02:39 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117704081, 'registration': 'LK67MFJ', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d SE 5dr Auto', 'mileage': 97619, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-10-17', 'fuel': 'Diesel', 'motExpiry': '2026-10-18', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600', 'https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600', 'https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600', 'https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600', 'https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600', 'https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600', 'https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600', 'https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/84380adf-719c-4aef-8ed7-19e5748c68a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:39 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117704081, 'registration': 'LK67MFJ', 'account': 'MER178', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS DIESEL HATCHBACK', 'derivative': 'A180d SE 5dr Auto', 'mileage': 97619, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-10-17', 'fuel': 'Diesel', 'motExpiry': '2026-10-18', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600', 'https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600', 'https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600', 'https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600', 'https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600', 'https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600', 'https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600', 'https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 98, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/84380adf-719c-4aef-8ed7-19e5748c68a6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eaff799-c9c3-56ff-a111-7fc77e95193b with identifier: 117704081
2025-12-04 19:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eaff799-c9c3-56ff-a111-7fc77e95193b with scrape type 1
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fba33329f-8610-4b27-a164-4598bd72d45c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ad9a90>
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704311?view=catalogue)
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F85d1022d-aedb-4135-9d19-f140ba81b2db.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600 not downloaded yet
2025-12-04 19:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f7627e89-a7b9-557e-a0a3-b1a107a52cf9 with identifier: 117708761
2025-12-04 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f7627e89-a7b9-557e-a0a3-b1a107a52cf9 with identifier: 117708761
2025-12-04 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 155489 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155489
2025-12-04 19:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: f7627e89-a7b9-557e-a0a3-b1a107a52cf9 spider: astonbarclay.gb
2025-12-04 19:02:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: f7627e89-a7b9-557e-a0a3-b1a107a52cf9 due to rule: high_mileage_for_country.json, error: 155489 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    155489
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'f7627e89-a7b9-557e-a0a3-b1a107a52cf9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR17LGY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117708761',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'S-MAX DIESEL ESTATE',
 'odometer': 96617,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-29',
 'seller_name': 'SMC Group',
 'title': 'FORD S-MAX DIESEL ESTATE 2.0 TDCi 180 Titanium 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDCi 180 Titanium 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117708761%27 HTTP/1.1" 200 None
2025-12-04 19:02:40 [astonbarclay.gb] INFO: Saving data for 117708761: {'created_time': 1764874960.133525, 'last_price_update_time': 1764874960.133537, 'auction_closing_time': 1765360800.0}
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117708761') HTTP/1.1" 204 0
2025-12-04 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F4949a990-f75a-4072-b273-594390085c26_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fa18b92d0-e282-49e8-a401-e578ddef865e.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600 not downloaded yet
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a7ae90>
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Ff7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4941650>
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48bfa50>
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fbd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9c3ae166-e776-4315-bab1-33e2eddb456d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117081997?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a2e490>
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4948750>
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600 saved to cache
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item eb31c3cb-594b-5edf-b5bd-55cff562a335
2025-12-04 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F9acb5be7-c761-490b-97e6-eef52961b683.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59eff90>
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600 saved to cache
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item eb31c3cb-594b-5edf-b5bd-55cff562a335
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F0db579de-e39d-4259-ab19-36d2ff2641f5.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F739c6f52-110b-4f75-b3a7-04e003851a9c.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600 not downloaded yet
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c742d0>
2025-12-04 19:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48d2950>
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fe1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a9f190>
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Fce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743814, 'registration': 'RK17DLD', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'PULSAR HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr Xtronic', 'mileage': 64276, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/18- 16K', 'remarks': 'VOSA STATES 46K, 51K, 57K, 62K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53f5f062-d61f-41c7-b55d-936eefc20902.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743814, 'registration': 'RK17DLD', 'account': 'WBA002', 'make': 'NISSAN', 'model': 'PULSAR HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr Xtronic', 'mileage': 64276, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-05', 'doors': 5, 'engineSize': 1198, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 04/18- 16K', 'remarks': 'VOSA STATES 46K, 51K, 57K, 62K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/53f5f062-d61f-41c7-b55d-936eefc20902.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with identifier: 117743814
2025-12-04 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with scrape type 1
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117676620, 'registration': 'EJ67EPZ', 'account': 'ESS008', 'make': 'FIAT', 'model': 'TIPO HATCHBACK', 'derivative': '1.4 Easy 5dr', 'mileage': 61801, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-16', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1368, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 13K - 01/20 30K - 12/20 35K - 04/25 ??', 'remarks': 'VOSA STATES, 44K, 49K, 53K, 58K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/394634e0-894d-484b-af02-2c3fb004f1b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117676620, 'registration': 'EJ67EPZ', 'account': 'ESS008', 'make': 'FIAT', 'model': 'TIPO HATCHBACK', 'derivative': '1.4 Easy 5dr', 'mileage': 61801, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-16', 'fuel': 'Petrol', 'motExpiry': '2026-02-10', 'doors': 5, 'engineSize': 1368, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600', 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 01/19 13K - 01/20 30K - 12/20 35K - 04/25 ??', 'remarks': 'VOSA STATES, 44K, 49K, 53K, 58K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 132, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/394634e0-894d-484b-af02-2c3fb004f1b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with identifier: 117676620
2025-12-04 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with scrape type 1
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Ff7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117081997, 'registration': 'EU20HYG', 'account': 'STE009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i Sport 5dr Step Auto', 'mileage': 43694, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-05', 'fuel': 'Petrol', 'motExpiry': '2026-01-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600', 'https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600', 'https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600', 'https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcfdd957-46e2-42a5-94ee-7381265eff2e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117081997, 'registration': 'EU20HYG', 'account': 'STE009', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i Sport 5dr Step Auto', 'mileage': 43694, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2020-03-05', 'fuel': 'Petrol', 'motExpiry': '2026-01-18', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600', 'https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600', 'https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600', 'https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'EVALUATE', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcfdd957-46e2-42a5-94ee-7381265eff2e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14f5be8b-c0ff-507e-af0b-cec363e13684 with identifier: 117081997
2025-12-04 19:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f5be8b-c0ff-507e-af0b-cec363e13684 with scrape type 1
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 14f5be8b-c0ff-507e-af0b-cec363e13684
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F220da52f-72ae-4536-b594-22a1a1732a51.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600 not downloaded yet
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576471?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576544?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48f7e90>
2025-12-04 19:02:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252Fd893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ef5010>
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252F6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fea3e0ba3-a607-4735-bf9f-208281750d74.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fe9fa6044-759b-4945-973c-21de3adf69ec.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600 not downloaded yet
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e7d5d0>
2025-12-04 19:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600 saved to cache
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e8efd0>
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e96890>
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fc01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F345d1642-051b-4c96-8788-41acb9d1d6ce.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600 not downloaded yet
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fe2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fd4d23fab-60ff-40cd-8876-225d658862e2.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600 not downloaded yet
2025-12-04 19:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4825f50>
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fba33329f-8610-4b27-a164-4598bd72d45c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600 saved to cache
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:44 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:44 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117289360, 'registration': 'GF69HHM', 'account': 'KCS002', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost 125 Active 5dr', 'mileage': 71629, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-19', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GF69HHM/2025-11-19/image/1a2dd15f-507a-4089-8e3e-d33a62dde49a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/47bff8ab-5d6c-43bd-ba90-1949281f76a0_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/e910b2a3-b0a6-4a6b-a1c0-94f41a4b3240_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a6a8f082-8492-4e04-ba9c-bd42e5b54df6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/a2cbdb09-b11f-4beb-8d74-52710d1642f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8239aebf-a648-43af-89fe-9b669be696a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/8fa1ade3-8646-4e29-8792-dfc81efac79d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/f272f34c-eb38-48d1-bd76-98c6ba235e11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/4ddebdb7-250c-4b2e-8b06-745505853fdf_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/b8ff893f-42a4-4400-91b4-4098fcaa4538_removebg.jpg?w=600', 'https://abimg003.imgix.net/GF69HHM/2025-11-19/image/ce91928d-a13d-4889-8b14-e2b1aae7a8d6_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/21 18K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8b9b1822-37b2-4035-81a7-8edafbd4b9b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-04 19:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-12-04 19:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with scrape type 2
2025-12-04 19:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839, identifier: 117289360
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117676438, 'registration': 'HN16YEL', 'account': 'ESS008', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 89114, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 40K, 51K, 65K, 80K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35884c14-4992-43e2-b38a-fd60d6fb9d62.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117676438, 'registration': 'HN16YEL', 'account': 'ESS008', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Signature Nav 5dr EDC', 'mileage': 89114, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-05-19', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600', 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 40K, 51K, 65K, 80K', 'virtual': False, 'seller': 'SMC GROUP', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/35884c14-4992-43e2-b38a-fd60d6fb9d62.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff with identifier: 117676438
2025-12-04 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff with scrape type 1
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fd867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576471, 'registration': 'LL18OHX', 'account': 'GAT019', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Bose Personal Edition 5dr CVT', 'mileage': 20418, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL18OHX/2025-11-28/image/29f16346-3e46-47fd-8c63-6b4160db624a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/b248b0b5-12f9-4670-b3d5-4f2b9a1c0970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/7d5ecbda-8323-4901-ac3e-454cc4354ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/c82a343a-cc7b-4100-83d1-54dff6736f76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/de669b7e-c48b-4f87-a970-f8f078a17a43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/412689f3-1375-41c8-91aa-a6abae1d2471_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/23998f80-f3b6-40b8-bab6-2ec83d969344_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/b0f0b275-8ceb-458e-8dbf-64328e96cdc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/2e6afc52-5451-4cba-a343-81128931fba6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 14K, 16K, 18K, 19K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2f30e6cf-cddf-4a29-8004-69a8c193304b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576471, 'registration': 'LL18OHX', 'account': 'GAT019', 'make': 'NISSAN', 'model': 'JUKE HATCHBACK', 'derivative': '1.6 Bose Personal Edition 5dr CVT', 'mileage': 20418, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-14', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LL18OHX/2025-11-28/image/29f16346-3e46-47fd-8c63-6b4160db624a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/b248b0b5-12f9-4670-b3d5-4f2b9a1c0970_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/7d5ecbda-8323-4901-ac3e-454cc4354ea4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/c82a343a-cc7b-4100-83d1-54dff6736f76_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/de669b7e-c48b-4f87-a970-f8f078a17a43_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/412689f3-1375-41c8-91aa-a6abae1d2471_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/23998f80-f3b6-40b8-bab6-2ec83d969344_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/b0f0b275-8ceb-458e-8dbf-64328e96cdc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LL18OHX/2025-11-28/image/2e6afc52-5451-4cba-a343-81128931fba6_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES, 14K, 16K, 18K, 19K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2f30e6cf-cddf-4a29-8004-69a8c193304b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with identifier: 117576471
2025-12-04 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with scrape type 2
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with scrape type 2
2025-12-04 19:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86, identifier: 117576471
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117576544, 'registration': 'WP19RYF', 'account': 'GAT021', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 220 AMG Line Premium 4dr Tip Auto', 'mileage': 68352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f6dd0477-9f24-4779-a80e-e2c09baa226d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/ffc06743-0c9b-4dfe-bc37-1041a0edfc15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/474c2ad0-c0e5-4a51-aaa7-320cddab33a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/19068790-1b05-4ad0-92b7-51b1767b7e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/e321e1af-18f2-442e-a783-779670f78193_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/717d92c4-3809-49c1-8bcb-deeece7ac53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f7a30748-d714-4212-9168-36bfd3ef891a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/694562d6-ae92-44cf-bb8a-affae647c087_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f6e9dbac-54ed-40b1-9cc5-e8385ded2418_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/504a73b9-beb3-4aa1-a6f3-bb2148290b03_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/20 5K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 12K, 26K, 42K, 52K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d3c8f4-3d0b-4575-8b4f-1cedf221a9ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117576544, 'registration': 'WP19RYF', 'account': 'GAT021', 'make': 'MERCEDES-BENZ', 'model': 'CLA COUPE', 'derivative': 'CLA 220 AMG Line Premium 4dr Tip Auto', 'mileage': 68352, 'mileageWarranty': True, 'type': 'car', 'saleId': 17996, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-29', 'fuel': 'Petrol', 'motExpiry': '2025-12-09', 'doors': 4, 'engineSize': 1991, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f6dd0477-9f24-4779-a80e-e2c09baa226d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/ffc06743-0c9b-4dfe-bc37-1041a0edfc15_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/474c2ad0-c0e5-4a51-aaa7-320cddab33a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/19068790-1b05-4ad0-92b7-51b1767b7e2d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/e321e1af-18f2-442e-a783-779670f78193_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/717d92c4-3809-49c1-8bcb-deeece7ac53b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f7a30748-d714-4212-9168-36bfd3ef891a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/694562d6-ae92-44cf-bb8a-affae647c087_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/f6e9dbac-54ed-40b1-9cc5-e8385ded2418_removebg.jpg?w=600', 'https://abimg003.imgix.net/WP19RYF/2025-11-28/image/504a73b9-beb3-4aa1-a6f3-bb2148290b03_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/20 5K', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 12K, 26K, 42K, 52K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Gates Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3d3c8f4-3d0b-4575-8b4f-1cedf221a9ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-12-04 19:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 094982e7-633f-5eb0-bb0f-0ae4dc90868a with scrape type 2
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 094982e7-633f-5eb0-bb0f-0ae4dc90868a with scrape type 2
2025-12-04 19:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 094982e7-633f-5eb0-bb0f-0ae4dc90868a, identifier: 117576544
2025-12-04 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F3ca82c2c-f022-4044-952c-b74df8e6521a.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600 not downloaded yet
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb6ca17de-faeb-40f9-af60-82db95f156bc.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600 not downloaded yet
2025-12-04 19:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-04 19:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360
2025-12-04 19:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839 with identifier: 117289360 to the API
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%274d1d8a92-dc30-51b8-9ad1-5b7aba17c839%27 HTTP/1.1" 200 None
2025-12-04 19:02:45 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 4d1d8a92-dc30-51b8-9ad1-5b7aba17c839: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:44 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117289360?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '4d1d8a92-dc30-51b8-9ad1-5b7aba17c839',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GF69HHM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117289360',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 71629,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost 125 Active 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Active 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117289360%27 HTTP/1.1" 200 None
2025-12-04 19:02:45 [astonbarclay.gb] INFO: Saving data for 117289360: {'auction_closing_time': 1765187100.0, 'created_time': 1763456563.337558, 'last_price_update_time': 1764874965.783174}
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117289360') HTTP/1.1" 204 0
2025-12-04 19:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with identifier: 117576471
2025-12-04 19:02:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with identifier: 117576471
2025-12-04 19:02:45 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86 with identifier: 117576471 to the API
2025-12-04 19:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2758d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86%27 HTTP/1.1" 200 None
2025-12-04 19:02:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:45 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576471?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '58d6d7d5-e6b4-5a91-ac00-7b37ec2c5c86',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LL18OHX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576471',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'JUKE HATCHBACK',
 'odometer': 20418,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': 'Gates Group',
 'title': 'NISSAN JUKE HATCHBACK 1.6 Bose Personal Edition 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.6 Bose Personal Edition 5dr CVT',
 'vin': None,
 'year': 2018}
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576471%27 HTTP/1.1" 200 None
2025-12-04 19:02:46 [astonbarclay.gb] INFO: Saving data for 117576471: {'auction_closing_time': 1765360800.0, 'created_time': 1764320466.056036, 'last_price_update_time': 1764874966.781776}
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576471') HTTP/1.1" 204 0
2025-12-04 19:02:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-12-04 19:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544
2025-12-04 19:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 094982e7-633f-5eb0-bb0f-0ae4dc90868a with identifier: 117576544 to the API
2025-12-04 19:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27094982e7-633f-5eb0-bb0f-0ae4dc90868a%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 094982e7-633f-5eb0-bb0f-0ae4dc90868a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:02:46 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576544?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '094982e7-633f-5eb0-bb0f-0ae4dc90868a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WP19RYF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576544',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA COUPE',
 'odometer': 68352,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-29',
 'seller_name': 'Gates Group',
 'title': 'MERCEDES-BENZ CLA COUPE CLA 220 AMG Line Premium 4dr Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 220 AMG Line Premium 4dr Tip Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576544%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [astonbarclay.gb] INFO: Saving data for 117576544: {'auction_closing_time': 1765360800.0, 'created_time': 1764270195.035851, 'last_price_update_time': 1764874967.791486}
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576544') HTTP/1.1" 204 0
2025-12-04 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252F10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600 not downloaded yet
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fa334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fb89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600 not downloaded yet
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fbf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:47 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:47 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b4ded0>
2025-12-04 19:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fcf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600 saved to cache
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a3ce50>
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd496e8d0>
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F4949a990-f75a-4072-b273-594390085c26_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117081997?view=catalogue)
2025-12-04 19:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg002.imgix.net%252Fc7655268-3674-48be-9bda-54a82a69861b.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600 not downloaded yet
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fdb795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48481d0>
2025-12-04 19:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1c55774b-9a3d-42b4-92c5-5cd091211299.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600 saved to cache
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:02:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117735005, 'registration': 'BL17KHC', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS DIESEL HATCHBACK', 'derivative': 'B200d Sport Executive 5dr Auto', 'mileage': 69061, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/18- 4K, 05/19- 10K, 05/20- 15K, 05/21- 19K, 05/22- 25K, 04/23- 30K, 06/24- 38K, 04/25- 57K', 'remarks': 'VOSA STATES 28K, 35K, 42K, 65K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9263585-d596-4c99-a4c4-7fbae8fd0ba1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117735005, 'registration': 'BL17KHC', 'account': 'WBA002', 'make': 'MERCEDES-BENZ', 'model': 'B CLASS DIESEL HATCHBACK', 'derivative': 'B200d Sport Executive 5dr Auto', 'mileage': 69061, 'mileageWarranty': True, 'type': 'car', 'saleId': 17997, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-10T10:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Diesel', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600', 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 05/18- 4K, 05/19- 10K, 05/20- 15K, 05/21- 19K, 05/22- 25K, 04/23- 30K, 06/24- 38K, 04/25- 57K', 'remarks': 'VOSA STATES 28K, 35K, 42K, 65K, SPARE KEY IN OFFICE, SD CARD IN OFFICE', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 106, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9263585-d596-4c99-a4c4-7fbae8fd0ba1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3d34861-fcf6-50ec-ab2b-a0def0617a38 with identifier: 117735005
2025-12-04 19:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3d34861-fcf6-50ec-ab2b-a0def0617a38 with scrape type 1
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4852f90>
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd485b0d0>
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F739c6f52-110b-4f75-b3a7-04e003851a9c.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600 saved to cache
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4855cd0>
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Ff7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b47690>
2025-12-04 19:02:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59ff210>
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9acb5be7-c761-490b-97e6-eef52961b683.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600 saved to cache
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252F52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fcb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117081997?view=catalogue)
2025-12-04 19:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Ff8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c22e50>
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47d8210>
2025-12-04 19:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F220da52f-72ae-4536-b594-22a1a1732a51.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600 saved to cache
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14f5be8b-c0ff-507e-af0b-cec363e13684
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47f7e90>
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600 saved to cache
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fe653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117081997?view=catalogue)
2025-12-04 19:02:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fb6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a8cb10>
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa7650>
2025-12-04 19:02:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fe2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd493ba10>
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fd867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b03790>
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600 saved to cache
2025-12-04 19:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4939490>
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600 saved to cache
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6871b90>
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59a0190>
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600 saved to cache
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd488cc10>
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F85d1022d-aedb-4135-9d19-f140ba81b2db.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600 saved to cache
2025-12-04 19:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48a7fd0>
2025-12-04 19:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fea3e0ba3-a607-4735-bf9f-208281750d74.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600 saved to cache
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14f5be8b-c0ff-507e-af0b-cec363e13684
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b93bd0>
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fa18b92d0-e282-49e8-a401-e578ddef865e.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600 saved to cache
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Ff249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117081997?view=catalogue)
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252Fbf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fc098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e53010>
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fdb795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4e290>
2025-12-04 19:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59f5ad0>
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fbf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e5e7d0>
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600 saved to cache
2025-12-04 19:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4f7d0>
2025-12-04 19:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4e6d0>
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F3ca82c2c-f022-4044-952c-b74df8e6521a.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600 saved to cache
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47de490>
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb6ca17de-faeb-40f9-af60-82db95f156bc.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600 saved to cache
2025-12-04 19:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e5c9d0>
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fd4d23fab-60ff-40cd-8876-225d658862e2.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600 saved to cache
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14f5be8b-c0ff-507e-af0b-cec363e13684
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a9dc10>
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F345d1642-051b-4c96-8788-41acb9d1d6ce.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600 saved to cache
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c43410>
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4791250>
2025-12-04 19:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fa334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:02:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fd5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a26510>
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59ef410>
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4785d10>
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc7655268-3674-48be-9bda-54a82a69861b.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600 saved to cache
2025-12-04 19:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e63910>
2025-12-04 19:02:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Ff8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a898d0>
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600 saved to cache
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd68ce9d0>
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600 saved to cache
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14f5be8b-c0ff-507e-af0b-cec363e13684
2025-12-04 19:02:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14f5be8b-c0ff-507e-af0b-cec363e13684, skipping ID generation
2025-12-04 19:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14f5be8b-c0ff-507e-af0b-cec363e13684 with scrape type 1
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 14f5be8b-c0ff-507e-af0b-cec363e13684 from tracking dictionaries
2025-12-04 19:02:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14f5be8b-c0ff-507e-af0b-cec363e13684 sending to next pipeline
2025-12-04 19:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 14f5be8b-c0ff-507e-af0b-cec363e13684, identifier: 117081997
2025-12-04 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 14f5be8b-c0ff-507e-af0b-cec363e13684 with identifier: 117081997
2025-12-04 19:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 14f5be8b-c0ff-507e-af0b-cec363e13684 with identifier: 117081997
2025-12-04 19:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 14f5be8b-c0ff-507e-af0b-cec363e13684 with identifier: 117081997 to the API
2025-12-04 19:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '14f5be8b-c0ff-507e-af0b-cec363e13684',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EU20HYG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117081997',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 43694,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91050,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/220da52f-72ae-4536-b594-22a1a1732a51.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82891,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/ea3e0ba3-a607-4735-bf9f-208281750d74.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72268,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/d4d23fab-60ff-40cd-8876-225d658862e2.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14f5be8b-c0ff-507e-af0b-cec363e13684/14f5be8b-c0ff-507e-af0b-cec363e13684_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66901,
             'Height': 479,
             'OriginUrl': 'https://abimg002.imgix.net/b89e926b-f3fd-45a6-a0f5-c2c980a6978f.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-05',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 1 SERIES HATCHBACK 118i Sport 5dr Step Auto',
 'transmission': 'automatic',
 'trim': '118i Sport 5dr Step Auto',
 'vin': None,
 'year': 2020}
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117081997%27 HTTP/1.1" 200 None
2025-12-04 19:03:01 [astonbarclay.gb] INFO: Saving data for 117081997: {'created_time': 1764874981.113234, 'last_price_update_time': 1764874981.113244, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117081997') HTTP/1.1" 204 0
2025-12-04 19:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5fa0b90>
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fcb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f422d0>
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4e3d0>
2025-12-04 19:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c41fd0>
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600 saved to cache
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a75c90>
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fe9fa6044-759b-4945-973c-21de3adf69ec.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600 saved to cache
2025-12-04 19:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676620?view=catalogue)
2025-12-04 19:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704081?view=catalogue)
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ad90d0>
2025-12-04 19:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600 saved to cache
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5be7710>
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252Fe653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117743814?view=catalogue)
2025-12-04 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48a7e10>
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bfd110>
2025-12-04 19:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd68729d0>
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fb6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48a5e10>
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e96950>
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Ff249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704163?view=catalogue)
2025-12-04 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6917710>
2025-12-04 19:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117676438?view=catalogue)
2025-12-04 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702574?view=catalogue)
2025-12-04 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f8dc10>
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252F6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a8a410>
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEJ67EPZ%252F2025-12-04%252Fimage%252F52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95
2025-12-04 19:03:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95, skipping ID generation
2025-12-04 19:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with scrape type 1
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Removing item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 from tracking dictionaries
2025-12-04 19:03:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 sending to next pipeline
2025-12-04 19:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95, identifier: 117676620
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5fcb050>
2025-12-04 19:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600 saved to cache
2025-12-04 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1eaff799-c9c3-56ff-a111-7fc77e95193b
2025-12-04 19:03:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eaff799-c9c3-56ff-a111-7fc77e95193b, skipping ID generation
2025-12-04 19:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1eaff799-c9c3-56ff-a111-7fc77e95193b with scrape type 1
2025-12-04 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 1eaff799-c9c3-56ff-a111-7fc77e95193b from tracking dictionaries
2025-12-04 19:03:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eaff799-c9c3-56ff-a111-7fc77e95193b sending to next pipeline
2025-12-04 19:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1eaff799-c9c3-56ff-a111-7fc77e95193b, identifier: 117704081
2025-12-04 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117739170?view=catalogue)
2025-12-04 19:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:06 [scrapy.extensions.logstats] INFO: Crawled 238 pages (at 69 pages/min), scraped 141 items (at 42 items/min)
2025-12-04 19:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with identifier: 117676620
2025-12-04 19:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with identifier: 117676620
2025-12-04 19:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95 with identifier: 117676620 to the API
2025-12-04 19:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 132,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EJ67EPZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117676620',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FIAT',
 'model': 'TIPO HATCHBACK',
 'odometer': 61801,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42279,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f7bd7eb0-7ed9-467d-9954-e54760693da7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43002,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/6a61f758-244d-4061-8d80-ea811c5c2c78_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35862,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e2bf465a-4665-43b5-a904-3a96694f1823_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36698,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/a334ebe2-1605-477e-a8d6-bd3fb76ff597_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49560,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/db795bc2-e0fe-465f-9976-33e56f205dc2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44835,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/52b5abe8-7aa6-467b-a5af-adc2dcfd1f15_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43745,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/f8b5a7cb-84ef-495c-9ea4-8185a9d88b99_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95/ff3fefe2-3b85-5b3e-944a-1e91ef6e0a95_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34569,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EJ67EPZ/2025-12-04/image/e653167d-ef0b-4476-9632-f83ce5a1b02f_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-16',
 'seller_name': 'SMC GROUP',
 'title': 'FIAT TIPO HATCHBACK 1.4 Easy 5dr',
 'transmission': 'manual',
 'trim': '1.4 Easy 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676620%27 HTTP/1.1" 200 None
2025-12-04 19:03:07 [astonbarclay.gb] INFO: Saving data for 117676620: {'created_time': 1764874987.637468, 'last_price_update_time': 1764874987.637478, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117676620') HTTP/1.1" 204 0
2025-12-04 19:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1eaff799-c9c3-56ff-a111-7fc77e95193b with identifier: 117704081
2025-12-04 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1eaff799-c9c3-56ff-a111-7fc77e95193b with identifier: 117704081
2025-12-04 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 157102 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157102
2025-12-04 19:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 1eaff799-c9c3-56ff-a111-7fc77e95193b spider: astonbarclay.gb
2025-12-04 19:03:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1eaff799-c9c3-56ff-a111-7fc77e95193b due to rule: high_mileage_for_country.json, error: 157102 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    157102
{'auction_title': '',
 'c_o_2_emission_value': 98,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '1eaff799-c9c3-56ff-a111-7fc77e95193b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LK67MFJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117704081',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS DIESEL HATCHBACK',
 'odometer': 97619,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75753,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/ba33329f-8610-4b27-a164-4598bd72d45c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101300,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/a18b92d0-e282-49e8-a401-e578ddef865e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76920,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9acb5be7-c761-490b-97e6-eef52961b683.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80170,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/3a1f1112-8ad1-4abd-aac7-d3dfb4ab0b59.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87870,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/1e6275a3-a2b8-4d5f-9666-f058fcc7c903.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97864,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/345d1642-051b-4c96-8788-41acb9d1d6ce.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91960,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/10d25068-75f5-43f0-8621-2bfb6413c1e1.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eaff799-c9c3-56ff-a111-7fc77e95193b/1eaff799-c9c3-56ff-a111-7fc77e95193b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39919,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/c7655268-3674-48be-9bda-54a82a69861b.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-17',
 'seller_name': 'Hedin Automotive',
 'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A180d SE 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A180d SE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704081%27 HTTP/1.1" 200 None
2025-12-04 19:03:07 [astonbarclay.gb] INFO: Saving data for 117704081: {'created_time': 1764874987.944195, 'last_price_update_time': 1764874987.944206, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117704081') HTTP/1.1" 204 0
2025-12-04 19:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:07 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:07 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4d090>
2025-12-04 19:03:07 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd80c2f50>
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252F56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa49d0>
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FRK17DLD%252F2025-12-04%252Fimage%252Fbf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97
2025-12-04 19:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97, skipping ID generation
2025-12-04 19:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with scrape type 1
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Removing item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 from tracking dictionaries
2025-12-04 19:03:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 sending to next pipeline
2025-12-04 19:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97, identifier: 117743814
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5aa7490>
2025-12-04 19:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252Fc098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b64350>
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704311?view=catalogue)
2025-12-04 19:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with identifier: 117743814
2025-12-04 19:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with identifier: 117743814
2025-12-04 19:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97 with identifier: 117743814 to the API
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RK17DLD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743814',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'NISSAN',
 'model': 'PULSAR HATCHBACK',
 'odometer': 64276,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35380,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/127a87ee-baa8-4dad-a3bb-689a5212dc39_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38891,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/56e3b873-111e-4f22-b158-6151fd8d957d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34588,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1f878d54-2b4e-40f1-b015-2767070e83ff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34111,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/99ada115-f1d7-4e4c-bff6-396ae8bd5fe6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56976,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/96ab2bb5-4410-41b0-baf2-422b951b1c12_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50347,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/1e5b8321-ad4f-453c-95b3-ea41fe6e611d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45621,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/0812b13e-90bb-48b3-8e99-710f96df4c76_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50043,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/7ecea8c4-c3b9-4967-97f3-c3444b299215_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52280,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/72c54946-1af1-44f9-ab02-f6243dcadb6a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97/cfbdc5cf-ac66-5bd8-90cd-d84e1e9ace97_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56940,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/RK17DLD/2025-12-04/image/bf549d41-fa5c-4043-bf28-0c14da20acf5_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-24',
 'seller_name': 'UKCGR - Premium',
 'title': 'NISSAN PULSAR HATCHBACK 1.2 DiG-T N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.2 DiG-T N-Connecta 5dr Xtronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743814%27 HTTP/1.1" 200 None
2025-12-04 19:03:09 [astonbarclay.gb] INFO: Saving data for 117743814: {'created_time': 1764874989.955649, 'last_price_update_time': 1764874989.955658, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743814') HTTP/1.1" 204 0
2025-12-04 19:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59e49d0>
2025-12-04 19:03:09 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Febcdef3c-4ce1-4ebf-9824-321c93658348.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600 saved to cache
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4f8e6d35-ec27-5748-a643-b500ac12e606
2025-12-04 19:03:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4f8e6d35-ec27-5748-a643-b500ac12e606, skipping ID generation
2025-12-04 19:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f8e6d35-ec27-5748-a643-b500ac12e606 with scrape type 1
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 4f8e6d35-ec27-5748-a643-b500ac12e606 from tracking dictionaries
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4f8e6d35-ec27-5748-a643-b500ac12e606 sending to next pipeline
2025-12-04 19:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4f8e6d35-ec27-5748-a643-b500ac12e606, identifier: 117704163
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4819650>
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F8eab3271-298b-44e0-b30b-0ce112354ee5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600 saved to cache
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4819bd0>
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F0db579de-e39d-4259-ab19-36d2ff2641f5.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600 saved to cache
2025-12-04 19:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117704311?view=catalogue)
2025-12-04 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4f8e6d35-ec27-5748-a643-b500ac12e606 with identifier: 117704163
2025-12-04 19:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4f8e6d35-ec27-5748-a643-b500ac12e606 with identifier: 117704163
2025-12-04 19:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4f8e6d35-ec27-5748-a643-b500ac12e606 with identifier: 117704163 to the API
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4f8e6d35-ec27-5748-a643-b500ac12e606',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LS22HFZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117704163',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 27540,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55382,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/cf26d8b3-8fe0-4ed4-a2b4-fd18b7de4620.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56031,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/ebcdef3c-4ce1-4ebf-9824-321c93658348.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41717,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/b3ac369f-14ee-44fa-ab6e-e69befbda45f.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56475,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/090a9603-8bcc-40db-b2dc-9c022e968bc7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57696,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/16bc0eca-b321-426a-b642-f5e796fa6eb7.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56879,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/739c6f52-110b-4f75-b3a7-04e003851a9c.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58494,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/70521eec-0ac8-4b8b-8004-bce1c16aad8d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51438,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/e9fa6044-759b-4945-973c-21de3adf69ec.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4f8e6d35-ec27-5748-a643-b500ac12e606/4f8e6d35-ec27-5748-a643-b500ac12e606_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36110,
             'Height': 299,
             'OriginUrl': 'https://abimg002.imgix.net/b6ca17de-faeb-40f9-af60-82db95f156bc.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-26',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 eTSI 150 Life 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 eTSI 150 Life 5dr DSG',
 'vin': None,
 'year': 2022}
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704163%27 HTTP/1.1" 200 None
2025-12-04 19:03:11 [astonbarclay.gb] INFO: Saving data for 117704163: {'created_time': 1764874991.296761, 'last_price_update_time': 1764874991.296772, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117704163') HTTP/1.1" 204 0
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a2bfd0>
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHN16YEL%252F2025-12-04%252Fimage%252F43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff
2025-12-04 19:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff, skipping ID generation
2025-12-04 19:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff with scrape type 1
2025-12-04 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff from tracking dictionaries
2025-12-04 19:03:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37f200f9-bc26-5ff9-bf0e-50cb570c97ff sending to next pipeline
2025-12-04 19:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff, identifier: 117676438
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd488a0d0>
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd485d310>
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252F9c3ae166-e776-4315-bab1-33e2eddb456d.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600 saved to cache
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48f1bd0>
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Ff5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600 saved to cache
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 57e4ad75-9f0f-5400-884e-065c779a06b9
2025-12-04 19:03:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 57e4ad75-9f0f-5400-884e-065c779a06b9, skipping ID generation
2025-12-04 19:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57e4ad75-9f0f-5400-884e-065c779a06b9 with scrape type 1
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 57e4ad75-9f0f-5400-884e-065c779a06b9 from tracking dictionaries
2025-12-04 19:03:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 57e4ad75-9f0f-5400-884e-065c779a06b9 sending to next pipeline
2025-12-04 19:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 57e4ad75-9f0f-5400-884e-065c779a06b9, identifier: 117702574
2025-12-04 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735005?view=catalogue)
2025-12-04 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117736230?view=catalogue)
2025-12-04 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117737357?view=catalogue)
2025-12-04 19:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff with identifier: 117676438
2025-12-04 19:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff with identifier: 117676438
2025-12-04 19:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 143414 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143414
2025-12-04 19:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff spider: astonbarclay.gb
2025-12-04 19:03:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 37f200f9-bc26-5ff9-bf0e-50cb570c97ff due to rule: high_mileage_for_make.json, error: 143414 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    143414
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '37f200f9-bc26-5ff9-bf0e-50cb570c97ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HN16YEL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117676438',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR DIESEL HATCHBACK',
 'odometer': 89114,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41297,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/d867a26d-4a73-446c-860f-8355a19a5294_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41843,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/bf6bc931-80a8-4dad-8a77-28348cf90ea3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31889,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/04ff4f34-2828-49eb-b96d-a95991155b7d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36404,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/557b3b85-532c-4b82-a064-08d56526f46b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58970,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/1c483a6e-24d5-447b-9761-df0d83d7c259_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54717,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/61b69881-43e4-4717-bf6b-43ae982c4c56_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47258,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/f249cf15-93c5-4e0a-8534-280f5dbcbfe3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52722,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/c098155c-a305-4ad1-be9e-9c9bdc3e1745_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37f200f9-bc26-5ff9-bf0e-50cb570c97ff/37f200f9-bc26-5ff9-bf0e-50cb570c97ff_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43465,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/HN16YEL/2025-12-04/image/43bb8506-b7f4-4137-93d3-7c8e817119bd_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-28',
 'seller_name': 'SMC GROUP',
 'title': 'RENAULT KADJAR DIESEL HATCHBACK 1.5 dCi Signature Nav 5dr EDC',
 'transmission': 'automatic',
 'trim': '1.5 dCi Signature Nav 5dr EDC',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117676438%27 HTTP/1.1" 200 None
2025-12-04 19:03:12 [astonbarclay.gb] INFO: Saving data for 117676438: {'created_time': 1764874992.911314, 'last_price_update_time': 1764874992.911324, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117676438') HTTP/1.1" 204 0
2025-12-04 19:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 57e4ad75-9f0f-5400-884e-065c779a06b9 with identifier: 117702574
2025-12-04 19:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 57e4ad75-9f0f-5400-884e-065c779a06b9 with identifier: 117702574
2025-12-04 19:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 57e4ad75-9f0f-5400-884e-065c779a06b9 with identifier: 117702574 to the API
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 165,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '57e4ad75-9f0f-5400-884e-065c779a06b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BG68VTL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117702574',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JAGUAR',
 'model': 'XE SALOON',
 'odometer': 46464,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83991,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/1c55774b-9a3d-42b4-92c5-5cd091211299.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77924,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/f5d8dfdf-cfbc-48aa-a568-d4045bfdb6f6.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52964,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/8eab3271-298b-44e0-b30b-0ce112354ee5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70618,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/85d1022d-aedb-4135-9d19-f140ba81b2db.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75159,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/9c3ae166-e776-4315-bab1-33e2eddb456d.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73928,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/0db579de-e39d-4259-ab19-36d2ff2641f5.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62485,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/34899cfe-6051-452a-a8ed-a0ca104c9ba4.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45842,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/15bd77aa-ecab-49ce-9bdd-aacac21fa936.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_57e4ad75-9f0f-5400-884e-065c779a06b9/57e4ad75-9f0f-5400-884e-065c779a06b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42870,
             'Height': 450,
             'OriginUrl': 'https://abimg002.imgix.net/3ca82c2c-f022-4044-952c-b74df8e6521a.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-11',
 'seller_name': 'Hedin Automotive',
 'title': 'JAGUAR XE SALOON 2.0 Ingenium R-Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Ingenium R-Sport 4dr Auto',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702574%27 HTTP/1.1" 200 None
2025-12-04 19:03:13 [astonbarclay.gb] INFO: Saving data for 117702574: {'created_time': 1764874993.281822, 'last_price_update_time': 1764874993.281831, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117702574') HTTP/1.1" 204 0
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f2ac10>
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252Fb17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd485ee10>
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fb6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c4d550>
2025-12-04 19:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEA18XUR%252F2025-12-04%252Fimage%252F066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f724f2eb-fa20-5e48-9acb-570d94f24af0
2025-12-04 19:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f724f2eb-fa20-5e48-9acb-570d94f24af0, skipping ID generation
2025-12-04 19:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f724f2eb-fa20-5e48-9acb-570d94f24af0 with scrape type 1
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f724f2eb-fa20-5e48-9acb-570d94f24af0 from tracking dictionaries
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f724f2eb-fa20-5e48-9acb-570d94f24af0 sending to next pipeline
2025-12-04 19:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f724f2eb-fa20-5e48-9acb-570d94f24af0, identifier: 117739170
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4824a50>
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252Fd5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f724f2eb-fa20-5e48-9acb-570d94f24af0 with identifier: 117739170
2025-12-04 19:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f724f2eb-fa20-5e48-9acb-570d94f24af0 with identifier: 117739170
2025-12-04 19:03:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f724f2eb-fa20-5e48-9acb-570d94f24af0 with identifier: 117739170 to the API
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f724f2eb-fa20-5e48-9acb-570d94f24af0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EA18XUR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117739170',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '308 HATCHBACK',
 'odometer': 50332,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35500,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ba9e346-96aa-4848-bc47-b5456c667431_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42348,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/066ac45b-5e82-4889-b6c5-89b2bc79b8ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36985,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/b17b6898-b0d7-4111-b591-9e19aefd89d5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37808,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/d893a67d-2995-4cfd-97c5-eb9daf295592_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43206,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/6ed4e77c-3817-4dc0-8ad9-0bb24dd8e81a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39776,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8ae92fcb-8240-42ba-b6cf-002c6f52c2b4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58008,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/144a2ffa-3048-45c7-bd68-530ee250b733_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44896,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/5cf25c59-f7d2-420f-a816-4791eec2ac86_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45922,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/8f4117b2-44f6-473d-aecc-602e15c0b52d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f724f2eb-fa20-5e48-9acb-570d94f24af0/f724f2eb-fa20-5e48-9acb-570d94f24af0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49984,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/EA18XUR/2025-12-04/image/11ff3290-6f80-401d-a8ea-5e360ebf16c7_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': 'UKCGR - Premium',
 'title': 'PEUGEOT 308 HATCHBACK 1.6 THP 205 GT 5dr',
 'transmission': 'manual',
 'trim': '1.6 THP 205 GT 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117739170%27 HTTP/1.1" 200 None
2025-12-04 19:03:14 [astonbarclay.gb] INFO: Saving data for 117739170: {'created_time': 1764874994.984324, 'last_price_update_time': 1764874994.984335, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117739170') HTTP/1.1" 204 0
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f10950>
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6ac24d0>
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fb5568abe-84b7-4d96-8fed-0f42de1984eb.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600 saved to cache
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item eb31c3cb-594b-5edf-b5bd-55cff562a335
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a94d90>
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd481d990>
2025-12-04 19:03:15 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg002.imgix.net%252Fc18955a3-e367-4114-8a96-10a6b17dd372.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600 saved to cache
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item eb31c3cb-594b-5edf-b5bd-55cff562a335
2025-12-04 19:03:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: eb31c3cb-594b-5edf-b5bd-55cff562a335, skipping ID generation
2025-12-04 19:03:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb31c3cb-594b-5edf-b5bd-55cff562a335 with scrape type 1
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Removing item eb31c3cb-594b-5edf-b5bd-55cff562a335 from tracking dictionaries
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item eb31c3cb-594b-5edf-b5bd-55cff562a335 sending to next pipeline
2025-12-04 19:03:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: eb31c3cb-594b-5edf-b5bd-55cff562a335, identifier: 117704311
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59f6490>
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252F3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a2acd0>
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ff272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:03:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: eb31c3cb-594b-5edf-b5bd-55cff562a335 with identifier: 117704311
2025-12-04 19:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: eb31c3cb-594b-5edf-b5bd-55cff562a335 with identifier: 117704311
2025-12-04 19:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: eb31c3cb-594b-5edf-b5bd-55cff562a335 with identifier: 117704311 to the API
2025-12-04 19:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'eb31c3cb-594b-5edf-b5bd-55cff562a335',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OE69BWV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117704311',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS DIESEL HATCHBACK',
 'odometer': 60960,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59983,
             'Height': 302,
             'OriginUrl': 'https://abimg002.imgix.net/f7542f8c-9df9-4a84-a4d4-4cd2d2caf86e.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63841,
             'Height': 302,
             'OriginUrl': 'https://abimg002.imgix.net/ee55eb72-5f6b-464e-bf57-ff022c9516e9.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49364,
             'Height': 302,
             'OriginUrl': 'https://abimg002.imgix.net/c18955a3-e367-4114-8a96-10a6b17dd372.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_eb31c3cb-594b-5edf-b5bd-55cff562a335/eb31c3cb-594b-5edf-b5bd-55cff562a335_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40217,
             'Height': 302,
             'OriginUrl': 'https://abimg002.imgix.net/b5568abe-84b7-4d96-8fed-0f42de1984eb.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-11-18',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'MERCEDES-BENZ A CLASS DIESEL HATCHBACK A180d AMG Line Executive 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'A180d AMG Line Executive 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117704311%27 HTTP/1.1" 200 None
2025-12-04 19:03:17 [astonbarclay.gb] INFO: Saving data for 117704311: {'created_time': 1764874997.18431, 'last_price_update_time': 1764874997.18432, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117704311') HTTP/1.1" 204 0
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47aaa50>
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL17KHC%252F2025-12-03%252Fimage%252F3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a3d34861-fcf6-50ec-ab2b-a0def0617a38
2025-12-04 19:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a3d34861-fcf6-50ec-ab2b-a0def0617a38, skipping ID generation
2025-12-04 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3d34861-fcf6-50ec-ab2b-a0def0617a38 with scrape type 1
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item a3d34861-fcf6-50ec-ab2b-a0def0617a38 from tracking dictionaries
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a3d34861-fcf6-50ec-ab2b-a0def0617a38 sending to next pipeline
2025-12-04 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a3d34861-fcf6-50ec-ab2b-a0def0617a38, identifier: 117735005
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ee1e10>
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMV68WXD%252F2025-12-03%252Fimage%252Fad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fa49bae2-8766-5df8-bf24-191d97be56e8
2025-12-04 19:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fa49bae2-8766-5df8-bf24-191d97be56e8, skipping ID generation
2025-12-04 19:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fa49bae2-8766-5df8-bf24-191d97be56e8 with scrape type 1
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Removing item fa49bae2-8766-5df8-bf24-191d97be56e8 from tracking dictionaries
2025-12-04 19:03:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fa49bae2-8766-5df8-bf24-191d97be56e8 sending to next pipeline
2025-12-04 19:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fa49bae2-8766-5df8-bf24-191d97be56e8, identifier: 117736230
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e6ac10>
2025-12-04 19:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252Ff96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47c9ed0>
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FKM18HHW%252F2025-12-04%252Fimage%252F2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 88b514d5-1b15-5a73-be3a-1082c27ed7de
2025-12-04 19:03:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 88b514d5-1b15-5a73-be3a-1082c27ed7de, skipping ID generation
2025-12-04 19:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88b514d5-1b15-5a73-be3a-1082c27ed7de with scrape type 1
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 88b514d5-1b15-5a73-be3a-1082c27ed7de from tracking dictionaries
2025-12-04 19:03:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 88b514d5-1b15-5a73-be3a-1082c27ed7de sending to next pipeline
2025-12-04 19:03:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 88b514d5-1b15-5a73-be3a-1082c27ed7de, identifier: 117737357
2025-12-04 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:03:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a3d34861-fcf6-50ec-ab2b-a0def0617a38 with identifier: 117735005
2025-12-04 19:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a3d34861-fcf6-50ec-ab2b-a0def0617a38 with identifier: 117735005
2025-12-04 19:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: a3d34861-fcf6-50ec-ab2b-a0def0617a38 with identifier: 117735005 to the API
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'a3d34861-fcf6-50ec-ab2b-a0def0617a38',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BL17KHC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117735005',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'B CLASS DIESEL HATCHBACK',
 'odometer': 69061,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30152,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/905cdaac-61e4-4564-9464-a929ee919b66_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32509,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/cb0e6c6a-3006-46fe-afeb-47dc3b511560_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33343,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/62339433-93de-4d25-aacf-da658dd5316c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31248,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/b6aba025-5966-4c3d-b372-917590fca0b4_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40184,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/72b63756-a905-4eaa-a9ff-9a256f0f02ed_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89817,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/0351ab9a-9368-4c25-99d8-f11183c29667_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94393,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/d5f90a8e-87c3-45c1-ad16-ed2d7184a053_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51975,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/102b397f-06b9-4849-b8a3-8ed571c8f519_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a3d34861-fcf6-50ec-ab2b-a0def0617a38/a3d34861-fcf6-50ec-ab2b-a0def0617a38_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43655,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/BL17KHC/2025-12-03/image/3227e409-2540-4c68-8635-9e3c59a6a3c6_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'UKCGR - Premium',
 'title': 'MERCEDES-BENZ B CLASS DIESEL HATCHBACK B200d Sport Executive 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': 'B200d Sport Executive 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735005%27 HTTP/1.1" 200 None
2025-12-04 19:03:19 [astonbarclay.gb] INFO: Saving data for 117735005: {'created_time': 1764874999.062981, 'last_price_update_time': 1764874999.062992, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117735005') HTTP/1.1" 204 0
2025-12-04 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fa49bae2-8766-5df8-bf24-191d97be56e8 with identifier: 117736230
2025-12-04 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fa49bae2-8766-5df8-bf24-191d97be56e8 with identifier: 117736230
2025-12-04 19:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fa49bae2-8766-5df8-bf24-191d97be56e8 with identifier: 117736230 to the API
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'fa49bae2-8766-5df8-bf24-191d97be56e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV68WXD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117736230',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 31971,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34954,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ad0e4302-0059-4059-abbd-a610e8e1b444_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37539,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/3b6342dd-3dd7-463e-8215-0036b5e4cc96_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34507,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/e1ed0e08-86eb-46b5-99ed-7ed5e8d1575c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34639,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/f7bbb4aa-451e-42d5-b55c-054d0c6eee05_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40814,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ac00e7b1-d571-461d-9aa2-73aed60cd4f5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43000,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/ca6cecd9-9ab3-4929-bf06-acdbedcf1ddf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46140,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/b6ded5ee-2c8e-4a76-be90-ce8d6714d9fb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55085,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/0d6df80a-891c-4537-959a-21ec6a8a4c53_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49615,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/c01cf46c-3e09-48f8-b1a1-3be7dd30f354_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fa49bae2-8766-5df8-bf24-191d97be56e8/fa49bae2-8766-5df8-bf24-191d97be56e8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59462,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MV68WXD/2025-12-03/image/4949a990-f75a-4072-b273-594390085c26_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-28',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost 125 Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost 125 Titanium 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117736230%27 HTTP/1.1" 200 None
2025-12-04 19:03:19 [astonbarclay.gb] INFO: Saving data for 117736230: {'created_time': 1764874999.44697, 'last_price_update_time': 1764874999.446979, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117736230') HTTP/1.1" 204 0
2025-12-04 19:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 88b514d5-1b15-5a73-be3a-1082c27ed7de with identifier: 117737357
2025-12-04 19:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 88b514d5-1b15-5a73-be3a-1082c27ed7de with identifier: 117737357
2025-12-04 19:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 88b514d5-1b15-5a73-be3a-1082c27ed7de with identifier: 117737357 to the API
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '88b514d5-1b15-5a73-be3a-1082c27ed7de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KM18HHW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117737357',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '2008 ESTATE',
 'odometer': 26163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37611,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/b228144a-dd2d-4fe6-8441-e0d5fd145965_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36688,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/fb0939bf-dcfe-47d4-a49c-845ac863e8ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29754,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/2c016b6d-4c2b-4d66-b7fe-4b9e07d9baca_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31248,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f96e01b6-c2c5-424b-bc2e-2336d75cf886_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49302,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/8345fbd8-4545-4609-b1e9-d44cd93df8ae_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53121,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/022641e7-a641-4177-bdb3-16a1e033bfe5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46810,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/bd0a0701-6b21-4dd4-a35b-2815ba389af2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39482,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/f272d641-28ab-4fa8-8c66-adf471ccf0eb_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_88b514d5-1b15-5a73-be3a-1082c27ed7de/88b514d5-1b15-5a73-be3a-1082c27ed7de_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52961,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/KM18HHW/2025-12-04/image/ce8273f1-3d41-4090-aa7e-2f0a73174f20_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-01',
 'seller_name': 'UKCGR - Premium',
 'title': 'PEUGEOT 2008 ESTATE 1.2 PureTech Active 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Active 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117737357%27 HTTP/1.1" 200 None
2025-12-04 19:03:19 [astonbarclay.gb] INFO: Saving data for 117737357: {'created_time': 1764874999.828643, 'last_price_update_time': 1764874999.828654, 'auction_closing_time': 1765360800.0}
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117737357') HTTP/1.1" 204 0
2025-12-04 19:03:19 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:19 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a71b50>
2025-12-04 19:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Ff7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e3ff50>
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252Fa154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e74a50>
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117740877?view=catalogue)
2025-12-04 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117635092?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c5ee90>
2025-12-04 19:03:20 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:03:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117764042?view=catalogue)
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ee8550>
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FMT65OEO%252F2025-12-04%252Fimage%252F5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3a4e0abc-3579-540b-9555-6d8c393645b8
2025-12-04 19:03:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3a4e0abc-3579-540b-9555-6d8c393645b8, skipping ID generation
2025-12-04 19:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3a4e0abc-3579-540b-9555-6d8c393645b8 with scrape type 1
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 3a4e0abc-3579-540b-9555-6d8c393645b8 from tracking dictionaries
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3a4e0abc-3579-540b-9555-6d8c393645b8 sending to next pipeline
2025-12-04 19:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3a4e0abc-3579-540b-9555-6d8c393645b8, identifier: 117740877
2025-12-04 19:03:21 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117635092, 'registration': 'NL16KHJ', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SE 5dr [A/C]', 'mileage': 76192, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/524b84d3-2d23-4a0e-b4f7-cfc66a2ee5b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/3ddc8377-8fdb-40fb-8b74-72cced2aa0ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/1e0b7e43-b61f-4276-a33f-46c3848aeb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/45253944-74d9-4273-b7c9-a6eb6325ef06_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/deff676f-d830-4ad8-9cc3-3357fd5670ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/6f62fb7f-1c4a-42ca-9e6e-ad8d85a55a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/469a02eb-e8c2-40e0-a7f6-7b5ce65e1c93_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/70e20c62-b4d8-42e5-b316-6768177a2ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/c6535424-bcc9-4b2c-8565-c18f055802dc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 11/19 18K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/95a3cff9-7b95-4239-b7aa-8a92e6e86c2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:21 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117635092, 'registration': 'NL16KHJ', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'VIVA HATCHBACK', 'derivative': '1.0 SE 5dr [A/C]', 'mileage': 76192, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-03-29', 'fuel': 'Petrol', 'motExpiry': '2025-11-10', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/524b84d3-2d23-4a0e-b4f7-cfc66a2ee5b6_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/3ddc8377-8fdb-40fb-8b74-72cced2aa0ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/1e0b7e43-b61f-4276-a33f-46c3848aeb4a_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/45253944-74d9-4273-b7c9-a6eb6325ef06_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/deff676f-d830-4ad8-9cc3-3357fd5670ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/6f62fb7f-1c4a-42ca-9e6e-ad8d85a55a0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/469a02eb-e8c2-40e0-a7f6-7b5ce65e1c93_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/70e20c62-b4d8-42e5-b316-6768177a2ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/NL16KHJ/2025-12-02/image/c6535424-bcc9-4b2c-8565-c18f055802dc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 11/19 18K,', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 104, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/95a3cff9-7b95-4239-b7aa-8a92e6e86c2c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-04 19:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with scrape type 2
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with scrape type 2
2025-12-04 19:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 44b627e8-b080-5c19-bc41-e7f99e4bdea1, identifier: 117635092
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd69315d0>
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252Feae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3a4e0abc-3579-540b-9555-6d8c393645b8 with identifier: 117740877
2025-12-04 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3a4e0abc-3579-540b-9555-6d8c393645b8 with identifier: 117740877
2025-12-04 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
2025-12-04 19:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: REGISTRATION_DATE_OLD failed for item: 3a4e0abc-3579-540b-9555-6d8c393645b8 spider: astonbarclay.gb
2025-12-04 19:03:22 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 3a4e0abc-3579-540b-9555-6d8c393645b8 due to rule: registration_date_old.json, error: 10 is greater than the maximum of 9

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['current_year_diff']:
    {'maximum': 9, 'type': 'number'}

On instance['current_year_diff']:
    10
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-09T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '3a4e0abc-3579-540b-9555-6d8c393645b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MT65OEO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117740877',
 'listing': 'auction',
 'location': 'Aston Barclay Donington Park',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK',
 'odometer': 92524,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28907,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/4f487417-c12d-4c9e-97cf-b67a3cb112c7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29850,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/5b74c3ef-001b-4ffa-b3d5-9a1b749f3aff_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25766,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/a154d61a-4e9e-451f-b30d-a1460f72c178_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27244,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/2ab6017d-7933-4dad-98b8-1a6dc52d64bd_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55512,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/957824e0-3b00-4f29-81f8-18b5ac7bc273_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58607,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/55537d2e-176d-42b0-a625-80e4309e797c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47215,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/b25c08b2-99a5-4080-86fc-1d2911049a7d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56056,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/cea89480-9bc1-449c-ad97-7cf038bbfb03_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3a4e0abc-3579-540b-9555-6d8c393645b8/3a4e0abc-3579-540b-9555-6d8c393645b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58230,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/MT65OEO/2025-12-04/image/f7d6f111-ded9-4f2c-982e-cc1b3126597d_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-16',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'VAUXHALL ASTRA HATCHBACK 1.4T 16V 150 SRi 5dr',
 'transmission': 'manual',
 'trim': '1.4T 16V 150 SRi 5dr',
 'vin': None,
 'year': 2015}
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117740877%27 HTTP/1.1" 200 None
2025-12-04 19:03:22 [astonbarclay.gb] INFO: Saving data for 117740877: {'created_time': 1764875002.071443, 'last_price_update_time': 1764875002.071452, 'auction_closing_time': 1765274400.0}
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117740877') HTTP/1.1" 204 0
2025-12-04 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-04 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092
2025-12-04 19:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 44b627e8-b080-5c19-bc41-e7f99e4bdea1 with identifier: 117635092 to the API
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2744b627e8-b080-5c19-bc41-e7f99e4bdea1%27 HTTP/1.1" 200 None
2025-12-04 19:03:22 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 44b627e8-b080-5c19-bc41-e7f99e4bdea1: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:21 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117635092?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '44b627e8-b080-5c19-bc41-e7f99e4bdea1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'NL16KHJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117635092',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VAUXHALL',
 'model': 'VIVA HATCHBACK',
 'odometer': 76192,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-29',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL VIVA HATCHBACK 1.0 SE 5dr [A/C]',
 'transmission': 'manual',
 'trim': '1.0 SE 5dr [A/C]',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117635092%27 HTTP/1.1" 200 None
2025-12-04 19:03:22 [astonbarclay.gb] INFO: Saving data for 117635092: {'auction_closing_time': 1765187100.0, 'created_time': 1764615824.210268, 'last_price_update_time': 1764875002.358677}
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117635092') HTTP/1.1" 204 0
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681173?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681183?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117773405?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117677953?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117681229?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c7e5d0>
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPE72ZRT%252F2025-12-04%252Fimage%252F7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c
2025-12-04 19:03:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c, skipping ID generation
2025-12-04 19:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with scrape type 1
2025-12-04 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Removing item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c from tracking dictionaries
2025-12-04 19:03:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5ea16de-e9ef-52e3-b6b5-0a0bdade411c sending to next pipeline
2025-12-04 19:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c, identifier: 117764042
2025-12-04 19:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with identifier: 117764042
2025-12-04 19:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with identifier: 117764042
2025-12-04 19:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f5ea16de-e9ef-52e3-b6b5-0a0bdade411c with identifier: 117764042 to the API
2025-12-04 19:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-09T10:15:00Z',
 'fuel_type': 'Petrol',
 'id': 'f5ea16de-e9ef-52e3-b6b5-0a0bdade411c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PE72ZRT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117764042',
 'listing': 'auction',
 'location': 'Aston Barclay Prees Heath',
 'make': 'KIA',
 'model': 'PICANTO HATCHBACK',
 'odometer': 7670,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34109,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/a0551b43-3055-4da8-8ed6-7e7efa69f7a5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32632,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/9f8acb95-eb5e-4e72-a381-c4865640c593_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35488,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ffefd3c1-f2fa-4ac5-a184-7e42a5e4224d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34091,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/0033b958-6fd5-46cc-bd53-29b7210b5e97_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39535,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/7083f565-6e3b-44ef-b7e6-fdeafd7ac68f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53533,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/ef41ffdf-b3cd-47ce-88cd-b708871bc109_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63932,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/eae5a6d8-136c-4679-a8e0-36d17c9befdf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51508,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/d86df1a0-2d52-4d04-a9a8-d9d878f8fbd6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72257,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/716433d3-f143-4317-ab87-cc71d4ef51e6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38703,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/88d7903d-f75f-4b95-92ad-a111cf41a2f0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5ea16de-e9ef-52e3-b6b5-0a0bdade411c/f5ea16de-e9ef-52e3-b6b5-0a0bdade411c_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72582,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/PE72ZRT/2025-12-04/image/82036d40-5d16-4c4e-9f77-312c9533686e_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Motability Operations',
 'title': 'KIA PICANTO HATCHBACK 1.0 X-Line S 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.0 X-Line S 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117764042%27 HTTP/1.1" 200 None
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Saving data for 117764042: {'created_time': 1764875003.156461, 'last_price_update_time': 1764875003.156472, 'auction_closing_time': 1765275300.0}
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117764042') HTTP/1.1" 204 0
2025-12-04 19:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117330721?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117214904, 'registration': 'OH04ALH', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 95 SE 5dr', 'mileage': 54191, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-07-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '*SELLING ON CP*', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cfc5978-3593-454c-be0e-ef83990c622b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117214904, 'registration': 'OH04ALH', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'POLO HATCHBACK', 'derivative': '1.0 TSI 95 SE 5dr', 'mileage': 54191, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-07-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '*SELLING ON CP*', 'virtual': False, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 101, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8cfc5978-3593-454c-be0e-ef83990c622b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfc655be-8013-5d77-ac9c-c7550de27caf with identifier: 117214904
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc655be-8013-5d77-ac9c-c7550de27caf with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252Fa9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681173, 'registration': 'LX66TGY', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 75141, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681173, 'registration': 'LX66TGY', 'account': 'WIL004', 'make': 'FORD', 'model': 'FOCUS HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 75141, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-09-23', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 121a8f9b-9283-5f08-8b5a-608b80238dd3 with identifier: 117681173
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 121a8f9b-9283-5f08-8b5a-608b80238dd3 with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 121a8f9b-9283-5f08-8b5a-608b80238dd3
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 121a8f9b-9283-5f08-8b5a-608b80238dd3
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 121a8f9b-9283-5f08-8b5a-608b80238dd3, identifier: 117681173
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681183, 'registration': 'FD17RYJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 75906, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-06-09', 'fuel': 'Diesel', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681183, 'registration': 'FD17RYJ', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'X-TRAIL DIESEL STATION WAGON', 'derivative': '1.6 dCi Tekna 5dr Xtronic', 'mileage': 75906, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-06-09', 'fuel': 'Diesel', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fd5d36b-4322-5cd2-95aa-216d1db2a149 with identifier: 117681183
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fd5d36b-4322-5cd2-95aa-216d1db2a149 with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 1fd5d36b-4322-5cd2-95aa-216d1db2a149
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 1fd5d36b-4322-5cd2-95aa-216d1db2a149
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1fd5d36b-4322-5cd2-95aa-216d1db2a149, identifier: 117681183
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117773405, 'registration': 'MK68RZF', 'account': 'AST002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.5 EcoBoost ST-2 3dr', 'mileage': 55250, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-14', 'fuel': 'Petrol', 'motExpiry': '2025-07-19', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eab08a06-8654-49cd-8e9f-a2e4daee8a8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117773405, 'registration': 'MK68RZF', 'account': 'AST002', 'make': 'FORD', 'model': 'FIESTA HATCHBACK', 'derivative': '1.5 EcoBoost ST-2 3dr', 'mileage': 55250, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-09-14', 'fuel': 'Petrol', 'motExpiry': '2025-07-19', 'doors': 3, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 136, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/eab08a06-8654-49cd-8e9f-a2e4daee8a8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a with identifier: 117773405
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a, identifier: 117773405
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117677953, 'registration': 'GJ67JWD', 'account': 'THE109', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr', 'mileage': 107278, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-09-14', 'fuel': 'Diesel', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117677953, 'registration': 'GJ67JWD', 'account': 'THE109', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 SE Tech 5dr', 'mileage': 107278, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-09-14', 'fuel': 'Diesel', 'motExpiry': '2026-03-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': None, 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4f8a368-ac7b-5f48-ab24-5acf7e68458d with identifier: 117677953
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4f8a368-ac7b-5f48-ab24-5acf7e68458d with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item a4f8a368-ac7b-5f48-ab24-5acf7e68458d
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item a4f8a368-ac7b-5f48-ab24-5acf7e68458d
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a4f8a368-ac7b-5f48-ab24-5acf7e68458d, identifier: 117677953
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117681229, 'registration': 'LD16OYB', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 31850, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117681229, 'registration': 'LD16OYB', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna [Non-Panoramic] 5dr', 'mileage': 31850, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-05-13', 'fuel': 'Petrol', 'motExpiry': '2026-11-10', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 133, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7146acb2-059d-5488-bbd8-a9dd28fd5898 with identifier: 117681229
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7146acb2-059d-5488-bbd8-a9dd28fd5898 with scrape type 1
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 7146acb2-059d-5488-bbd8-a9dd28fd5898
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 7146acb2-059d-5488-bbd8-a9dd28fd5898
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7146acb2-059d-5488-bbd8-a9dd28fd5898, identifier: 117681229
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117633088, 'registration': 'BP21VJZ', 'account': 'NIC026', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 42018, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 09/25 (NO MILEAGE)', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3130d656-eb6d-4da4-bc62-5e3018a0b718.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117633088, 'registration': 'BP21VJZ', 'account': 'NIC026', 'make': 'NISSAN', 'model': 'MICRA HATCHBACK', 'derivative': '1.0 IG-T 92 Acenta 5dr CVT', 'mileage': 42018, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2021-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-09-08', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/5dd995d3-b1f3-4832-9f07-de0fc1c98448_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/54c4e76f-e1e0-47a7-a823-1d3afe54029b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/9f50c84c-6b86-4d9f-80f1-79288ee29428_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/80abf68f-e1bc-4789-9137-4f20d11ef084_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b96c9726-60c0-4a1c-bc0c-0c5b30877255_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP21VJZ/2025-12-01/image/b30108c0-5021-4ace-b3c0-ac4c49294250_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 09/25 (NO MILEAGE)', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3130d656-eb6d-4da4-bc62-5e3018a0b718.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-04 19:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 034ce54f-db67-523a-be2a-d5bd40f6f22c with scrape type 2
2025-12-04 19:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 034ce54f-db67-523a-be2a-d5bd40f6f22c with scrape type 2
2025-12-04 19:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 034ce54f-db67-523a-be2a-d5bd40f6f22c, identifier: 117633088
2025-12-04 19:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 121a8f9b-9283-5f08-8b5a-608b80238dd3 with identifier: 117681173
2025-12-04 19:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 121a8f9b-9283-5f08-8b5a-608b80238dd3 with identifier: 117681173
2025-12-04 19:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 121a8f9b-9283-5f08-8b5a-608b80238dd3 with identifier: 117681173 to the API
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27121a8f9b-9283-5f08-8b5a-608b80238dd3%27 HTTP/1.1" 200 None
2025-12-04 19:03:24 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 121a8f9b-9283-5f08-8b5a-608b80238dd3: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:23 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117681173?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '121a8f9b-9283-5f08-8b5a-608b80238dd3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LX66TGY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681173',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK',
 'odometer': 75141,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-23',
 'seller_name': 'Wilsons',
 'title': 'FORD FOCUS HATCHBACK 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681173%27 HTTP/1.1" 200 None
2025-12-04 19:03:24 [astonbarclay.gb] INFO: Saving data for 117681173: {'created_time': 1764875004.047216, 'last_price_update_time': 1764875004.047226, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681173') HTTP/1.1" 204 0
2025-12-04 19:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1fd5d36b-4322-5cd2-95aa-216d1db2a149 with identifier: 117681183
2025-12-04 19:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1fd5d36b-4322-5cd2-95aa-216d1db2a149 with identifier: 117681183
2025-12-04 19:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 1fd5d36b-4322-5cd2-95aa-216d1db2a149 with identifier: 117681183 to the API
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%271fd5d36b-4322-5cd2-95aa-216d1db2a149%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 1fd5d36b-4322-5cd2-95aa-216d1db2a149: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117681183?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '1fd5d36b-4322-5cd2-95aa-216d1db2a149',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FD17RYJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681183',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'X-TRAIL DIESEL STATION WAGON',
 'odometer': 75906,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-09',
 'seller_name': 'Wilsons',
 'title': 'NISSAN X-TRAIL DIESEL STATION WAGON 1.6 dCi Tekna 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.6 dCi Tekna 5dr Xtronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681183%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [astonbarclay.gb] INFO: Saving data for 117681183: {'created_time': 1764875005.061435, 'last_price_update_time': 1764875005.061446, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681183') HTTP/1.1" 204 0
2025-12-04 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a with identifier: 117773405
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a with identifier: 117773405
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a with identifier: 117773405 to the API
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277cad0aa0-b257-5ea1-a0c7-3095d0d2b22a%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117773405?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 136,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7cad0aa0-b257-5ea1-a0c7-3095d0d2b22a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MK68RZF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117773405',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'FIESTA HATCHBACK',
 'odometer': 55250,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-14',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FIESTA HATCHBACK 1.5 EcoBoost ST-2 3dr',
 'transmission': 'manual',
 'trim': '1.5 EcoBoost ST-2 3dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117773405%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [astonbarclay.gb] INFO: Saving data for 117773405: {'created_time': 1764875005.350635, 'last_price_update_time': 1764875005.350644, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117773405') HTTP/1.1" 204 0
2025-12-04 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a4f8a368-ac7b-5f48-ab24-5acf7e68458d with identifier: 117677953
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a4f8a368-ac7b-5f48-ab24-5acf7e68458d with identifier: 117677953
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 172646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172646
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: a4f8a368-ac7b-5f48-ab24-5acf7e68458d spider: astonbarclay.gb
2025-12-04 19:03:25 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a4f8a368-ac7b-5f48-ab24-5acf7e68458d due to rule: high_mileage_for_country.json, error: 172646 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    172646
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': 'a4f8a368-ac7b-5f48-ab24-5acf7e68458d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GJ67JWD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117677953',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 107278,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-14',
 'seller_name': 'TCB Group - Prime',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 SE Tech 5dr',
 'transmission': 'manual',
 'trim': '2.0 TD4 180 SE Tech 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117677953%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [astonbarclay.gb] INFO: Saving data for 117677953: {'created_time': 1764875005.564836, 'last_price_update_time': 1764875005.564846, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117677953') HTTP/1.1" 204 0
2025-12-04 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7146acb2-059d-5488-bbd8-a9dd28fd5898 with identifier: 117681229
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7146acb2-059d-5488-bbd8-a9dd28fd5898 with identifier: 117681229
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7146acb2-059d-5488-bbd8-a9dd28fd5898 with identifier: 117681229 to the API
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277146acb2-059d-5488-bbd8-a9dd28fd5898%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7146acb2-059d-5488-bbd8-a9dd28fd5898: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:24 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117681229?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 133,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7146acb2-059d-5488-bbd8-a9dd28fd5898',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LD16OYB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117681229',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 31850,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-13',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna [Non-Panoramic] 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117681229%27 HTTP/1.1" 200 None
2025-12-04 19:03:25 [astonbarclay.gb] INFO: Saving data for 117681229: {'created_time': 1764875005.853106, 'last_price_update_time': 1764875005.853116, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117681229') HTTP/1.1" 204 0
2025-12-04 19:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-04 19:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088
2025-12-04 19:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 034ce54f-db67-523a-be2a-d5bd40f6f22c with identifier: 117633088 to the API
2025-12-04 19:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117633088?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '034ce54f-db67-523a-be2a-d5bd40f6f22c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP21VJZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117633088',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'MICRA HATCHBACK',
 'odometer': 42018,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-31',
 'seller_name': 'Local Dealer Group',
 'title': 'NISSAN MICRA HATCHBACK 1.0 IG-T 92 Acenta 5dr CVT',
 'transmission': 'automatic',
 'trim': '1.0 IG-T 92 Acenta 5dr CVT',
 'vin': None,
 'year': 2021}
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117633088%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Saving data for 117633088: {'auction_closing_time': 1765187100.0, 'created_time': 1764615828.23533, 'last_price_update_time': 1764875006.150438}
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117633088') HTTP/1.1" 204 0
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117330721, 'registration': 'ND17YCN', 'account': 'ILI003', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 91094, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND17YCN/2025-11-20/image/fba5521c-a07b-410b-9cad-9cd6a2f6a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/6e8c4a21-f010-4247-997d-e18432798f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/494e77fe-8b5a-45dd-bc62-a99cf9dd1778_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/b566f82c-67b4-408c-9913-5dcd749ca111_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/ab9e97ba-f66f-4030-b991-5e5e63ea84a0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 02/24 69K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89992523-6768-44fe-804d-2941601b85b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117330721, 'registration': 'ND17YCN', 'account': 'ILI003', 'make': 'PEUGEOT', 'model': '3008 ESTATE', 'derivative': '1.2 PureTech Allure 5dr', 'mileage': 91094, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-28', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/ND17YCN/2025-11-20/image/fba5521c-a07b-410b-9cad-9cd6a2f6a76a_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/6e8c4a21-f010-4247-997d-e18432798f41_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/494e77fe-8b5a-45dd-bc62-a99cf9dd1778_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/b566f82c-67b4-408c-9913-5dcd749ca111_removebg.jpg?w=600', 'https://abimg003.imgix.net/ND17YCN/2025-11-20/image/ab9e97ba-f66f-4030-b991-5e5e63ea84a0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service invoice 02/24 69K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/89992523-6768-44fe-804d-2941601b85b2.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-12-04 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2d555d4-2de3-57f4-ab25-aef6992f84f8 with scrape type 2
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2d555d4-2de3-57f4-ab25-aef6992f84f8 with scrape type 2
2025-12-04 19:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c2d555d4-2de3-57f4-ab25-aef6992f84f8, identifier: 117330721
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-12-04 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 with identifier: 117330721
2025-12-04 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 146601 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146601
2025-12-04 19:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: c2d555d4-2de3-57f4-ab25-aef6992f84f8 spider: astonbarclay.gb
2025-12-04 19:03:26 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: c2d555d4-2de3-57f4-ab25-aef6992f84f8 due to rule: high_mileage_for_make.json, error: 146601 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    146601
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'c2d555d4-2de3-57f4-ab25-aef6992f84f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ND17YCN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117330721',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'PEUGEOT',
 'model': '3008 ESTATE',
 'odometer': 91094,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-30',
 'seller_name': 'Local Dealer Group',
 'title': 'PEUGEOT 3008 ESTATE 1.2 PureTech Allure 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Allure 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117330721%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Saving data for 117330721: {'auction_closing_time': 1765359900.0, 'created_time': 1763578955.378365, 'last_price_update_time': 1764875006.53948}
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117330721') HTTP/1.1" 204 0
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252Fd2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117576849?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115431227?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116134889?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743322?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117576849, 'registration': 'YR68KBN', 'account': 'RBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 182 Titanium 5dr Auto', 'mileage': 78734, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ae35a47-0458-4a9c-a4fa-1716a9023f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/75c035a0-6059-4d2d-9eae-bb0484b5cd61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/a4109bdc-41f4-4357-bd69-f720674e5cef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/63a07bc9-7896-403e-b749-f3dd32158f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ee66786-d321-4ed6-a027-e6410ccd0500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/1fd1baeb-a55c-43df-9acd-7ba5a7f55dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book SB 10/19 9K 09/21 29K / SP 10/20 19K / INV 07/23 52K', 'remarks': 'SKEY', 'virtual': False, 'seller': '.', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29fe4ff4-89c6-4690-b9c7-33c7669734fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:26 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117576849, 'registration': 'YR68KBN', 'account': 'RBA001', 'make': 'FORD', 'model': 'KUGA ESTATE', 'derivative': '1.5 EcoBoost 182 Titanium 5dr Auto', 'mileage': 78734, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-10-16', 'fuel': 'Petrol', 'motExpiry': '2026-08-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ae35a47-0458-4a9c-a4fa-1716a9023f03_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/75c035a0-6059-4d2d-9eae-bb0484b5cd61_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/a4109bdc-41f4-4357-bd69-f720674e5cef_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/63a07bc9-7896-403e-b749-f3dd32158f7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/8ee66786-d321-4ed6-a027-e6410ccd0500_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR68KBN/2025-12-01/image/1fd1baeb-a55c-43df-9acd-7ba5a7f55dd1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book SB 10/19 9K 09/21 29K / SP 10/20 19K / INV 07/23 52K', 'remarks': 'SKEY', 'virtual': False, 'seller': '.', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 173, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/29fe4ff4-89c6-4690-b9c7-33c7669734fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-04 19:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with scrape type 2
2025-12-04 19:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with scrape type 2
2025-12-04 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a, identifier: 117576849
2025-12-04 19:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-04 19:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849
2025-12-04 19:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7ef74a89-3021-5833-8b27-7b3f0a37ff2a with identifier: 117576849 to the API
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%277ef74a89-3021-5833-8b27-7b3f0a37ff2a%27 HTTP/1.1" 200 None
2025-12-04 19:03:27 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 7ef74a89-3021-5833-8b27-7b3f0a37ff2a: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:26 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117576849?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 173,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7ef74a89-3021-5833-8b27-7b3f0a37ff2a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR68KBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117576849',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'FORD',
 'model': 'KUGA ESTATE',
 'odometer': 78734,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-10-16',
 'seller_name': '.',
 'title': 'FORD KUGA ESTATE 1.5 EcoBoost 182 Titanium 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 EcoBoost 182 Titanium 5dr Auto',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117576849%27 HTTP/1.1" 200 None
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Saving data for 117576849: {'auction_closing_time': 1765187100.0, 'created_time': 1764356524.973468, 'last_price_update_time': 1764875007.350059}
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117576849') HTTP/1.1" 204 0
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288965?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117743313?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115431227, 'registration': 'FE69XTH', 'account': 'CAR068', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto', 'mileage': 132609, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE69XTH/2025-09-18/image/08d472c3-e8c7-4c9b-85d4-9be998d05d88_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/cc827c19-5d80-4be3-b42f-e9c1a7f876cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/37731916-7162-4bf7-8099-134e8b521273_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c8beb894-0f9d-41db-9e96-799fa1c2825f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/12b9e71b-5d91-473d-ab23-1617063e02bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/1f306274-08d2-4305-ad7b-85ffaebd19d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/3d8c6113-3e09-4a6c-944a-345a5dfe6968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/f67f400e-3cd6-4622-9ea1-eb059854befa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/616590e5-fb3e-4c3b-8ee0-33d99547f6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c7b881a8-4536-4002-940b-d180ee0fb4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/7cec3cbf-5f43-4342-9441-59d0882dbc22_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/64c0e885-bba6-4dab-aedc-d3a64039c20c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 07/20 23K 06/21 46K 05/22 70K 09/23 96K 06/25 132K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Dealer Direct', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bc575e0-5f86-4fab-ab67-64decc0b0414.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115431227, 'registration': 'FE69XTH', 'account': 'CAR068', 'make': 'MINI', 'model': 'COUNTRYMAN HATCHBACK', 'derivative': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto', 'mileage': 132609, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-09-09', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2025-09-29', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FE69XTH/2025-09-18/image/08d472c3-e8c7-4c9b-85d4-9be998d05d88_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/cc827c19-5d80-4be3-b42f-e9c1a7f876cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/37731916-7162-4bf7-8099-134e8b521273_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c8beb894-0f9d-41db-9e96-799fa1c2825f_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/12b9e71b-5d91-473d-ab23-1617063e02bb_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/1f306274-08d2-4305-ad7b-85ffaebd19d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/3d8c6113-3e09-4a6c-944a-345a5dfe6968_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/f67f400e-3cd6-4622-9ea1-eb059854befa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/616590e5-fb3e-4c3b-8ee0-33d99547f6f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/c7b881a8-4536-4002-940b-d180ee0fb4dd_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/7cec3cbf-5f43-4342-9441-59d0882dbc22_removebg.jpg?w=600', 'https://abimg003.imgix.net/FE69XTH/2025-09-18/image/64c0e885-bba6-4dab-aedc-d3a64039c20c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 07/20 23K 06/21 46K 05/22 70K 09/23 96K 06/25 132K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'Dealer Direct', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 43, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9bc575e0-5f86-4fab-ab67-64decc0b0414.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-12-04 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f111dc5-eecc-5b17-97e5-972164540f4c with scrape type 2
2025-12-04 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8f111dc5-eecc-5b17-97e5-972164540f4c with scrape type 2
2025-12-04 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8f111dc5-eecc-5b17-97e5-972164540f4c, identifier: 115431227
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116134889, 'registration': 'GK67LBN', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '2.0 SD4 HSE 5dr Auto', 'mileage': 83163, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-09-01', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GK67LBN/2025-11-27/image/17ba72ed-54b2-4b0b-aa12-ed1cc2537017_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7f879194-052f-4226-87f8-7d9034626fcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/2e8ca53d-9a93-4333-b7b0-2bb2d777a018_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7ef14a5e-ceb4-44df-a9e1-79e9cde8e7f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/fc916a02-225f-4257-bb0c-d048fde9b41c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/3062baa7-e9f7-4b3a-8fc2-1c12b5177725_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/464cd1e0-95df-4e92-a8d7-674e916d1d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/af3e8a9a-cc95-4908-acdd-48f761357ead_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/ac8af102-ceee-4d60-91f1-b9621a69a827_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/1b25c4cd-cb02-4cb8-b9b0-deb0a7b0b415_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/f1e1a289-6d60-468f-b545-f4307bb4bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7df7be70-c975-415b-865d-22f4ccf812ae_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/18 21K 08/20 40K 10/20 43K / INV 05/24 74K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41c6abb3-fe79-4dd6-aa14-c86f2bc34244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116134889, 'registration': 'GK67LBN', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'DISCOVERY DIESEL SW', 'derivative': '2.0 SD4 HSE 5dr Auto', 'mileage': 83163, 'mileageWarranty': False, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-09-01', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/GK67LBN/2025-11-27/image/17ba72ed-54b2-4b0b-aa12-ed1cc2537017_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7f879194-052f-4226-87f8-7d9034626fcb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/2e8ca53d-9a93-4333-b7b0-2bb2d777a018_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7ef14a5e-ceb4-44df-a9e1-79e9cde8e7f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/fc916a02-225f-4257-bb0c-d048fde9b41c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/3062baa7-e9f7-4b3a-8fc2-1c12b5177725_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/464cd1e0-95df-4e92-a8d7-674e916d1d21_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/af3e8a9a-cc95-4908-acdd-48f761357ead_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/ac8af102-ceee-4d60-91f1-b9621a69a827_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/1b25c4cd-cb02-4cb8-b9b0-deb0a7b0b415_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/f1e1a289-6d60-468f-b545-f4307bb4bf1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GK67LBN/2025-11-27/image/7df7be70-c975-415b-865d-22f4ccf812ae_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/18 21K 08/20 40K 10/20 43K / INV 05/24 74K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/41c6abb3-fe79-4dd6-aa14-c86f2bc34244.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e6a9baf-a39a-5fac-90a5-976913c37793 with identifier: 116134889
2025-12-04 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e6a9baf-a39a-5fac-90a5-976913c37793 with scrape type 2
2025-12-04 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e6a9baf-a39a-5fac-90a5-976913c37793 with scrape type 2
2025-12-04 19:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6e6a9baf-a39a-5fac-90a5-976913c37793, identifier: 116134889
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117749600, 'registration': 'EK17AXM', 'account': 'ANC013', 'make': 'HYUNDAI', 'model': 'I20 HATCHBACK', 'derivative': '1.2 S Air 5dr', 'mileage': 104658, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/17 15K 02/19 24K 02/20 31K 02/21 40K 03/22 55K 03/23 69K 03/24 82K 03/25 94K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Anchor Group Remarketing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ac4510f-c09d-4a06-b1b6-8c51bbe52bb9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117749600, 'registration': 'EK17AXM', 'account': 'ANC013', 'make': 'HYUNDAI', 'model': 'I20 HATCHBACK', 'derivative': '1.2 S Air 5dr', 'mileage': 104658, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-10T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2017-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-11-30', 'doors': 5, 'engineSize': 1248, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600', 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/17 15K 02/19 24K 02/20 31K 02/21 40K 03/22 55K 03/23 69K 03/24 82K 03/25 94K', 'remarks': 'NO SPARE KEY', 'virtual': False, 'seller': 'Anchor Group Remarketing', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4ac4510f-c09d-4a06-b1b6-8c51bbe52bb9.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8617e9d-0657-5655-8192-c831e1b9d866 with identifier: 117749600
2025-12-04 19:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8617e9d-0657-5655-8192-c831e1b9d866 with scrape type 1
2025-12-04 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F567090c6-f121-494a-903f-b82732077fc7_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c17a90>
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6b2e710>
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:28 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743322, 'registration': 'ML18KWO', 'account': 'HAT006', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C250d AMG Line Premium 2dr Auto', 'mileage': 49048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-04-23', 'doors': 2, 'engineSize': 2143, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/21 - 36K, 07/22 - 38K, 07/23 - 41K, 09/24 - 45K, 10/25 - 48K,', 'remarks': '**29**VOSA STATES 33K, 38K, 40K, 43K, 46K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:28 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743322, 'registration': 'ML18KWO', 'account': 'HAT006', 'make': 'MERCEDES-BENZ', 'model': 'C CLASS DIESEL COUPE', 'derivative': 'C250d AMG Line Premium 2dr Auto', 'mileage': 49048, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-04-23', 'doors': 2, 'engineSize': 2143, 'bodyType': 'Coupe', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 06/21 - 36K, 07/22 - 38K, 07/23 - 41K, 09/24 - 45K, 10/25 - 48K,', 'remarks': '**29**VOSA STATES 33K, 38K, 40K, 43K, 46K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49551844-e386-58cb-8bab-99fef48f4e98 with identifier: 117743322
2025-12-04 19:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49551844-e386-58cb-8bab-99fef48f4e98 with scrape type 1
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 49551844-e386-58cb-8bab-99fef48f4e98
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 49551844-e386-58cb-8bab-99fef48f4e98
2025-12-04 19:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 49551844-e386-58cb-8bab-99fef48f4e98, identifier: 117743322
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b2f6d0>
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-12-04 19:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8f111dc5-eecc-5b17-97e5-972164540f4c with identifier: 115431227
2025-12-04 19:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'dealer direct', 'price_includes_vat': False, 'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'countryman hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 132609, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227', 'expiration_date': '2025-12-08t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.5 cooper s e classic all4 phev 5dr auto', 'license_plate': 'fe69xth', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 43, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'mini countryman hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 213412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 43,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-08t09:45:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fe69xth',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'mini',
     'make_model': 'mini countryman hatchback',
     'model': 'countryman hatchback',
     'odometer': 132609,
     'odometer_in_km': 213412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-09',
     'sanitized_make': 'mini',
     'seller_name': 'dealer direct',
     'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '1.5 cooper s e classic all4 phev 5dr auto',
     'vin': None,
     'year': 2019}
2025-12-04 19:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: 8f111dc5-eecc-5b17-97e5-972164540f4c spider: astonbarclay.gb
2025-12-04 19:03:28 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8f111dc5-eecc-5b17-97e5-972164540f4c due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 0, 'seller_name': 'dealer direct', 'price_includes_vat': False, 'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'mini', 'model': 'countryman hatchback', 'transmission': 'automatic', 'engine': '1.5l', 'fuel_type': 'petrol/plugin electric hybrid', 'odometer': 132609, 'odometer_reading_unit': 'mi', 'registration_date': '2019-09-09', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227', 'expiration_date': '2025-12-08t09:45:00z', 'location': 'aston barclay westbury', 'origin_country_code': 'gb', 'trim': '1.5 cooper s e classic all4 phev 5dr auto', 'license_plate': 'fe69xth', 'year': 2019, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 43, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c', 'current_year_diff': 6, 'age_in_months': 74, 'make_model': 'mini countryman hatchback', 'sanitized_make': 'mini', 'odometer_in_km': 213412}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 74,
     'auction_title': '',
     'c_o_2_emission_value': 43,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 6,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.5l',
     'expiration_date': '2025-12-08t09:45:00z',
     'fuel_type': 'petrol/plugin electric hybrid',
     'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'fe69xth',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
     'listing': 'auction',
     'location': 'aston barclay westbury',
     'make': 'mini',
     'make_model': 'mini countryman hatchback',
     'model': 'countryman hatchback',
     'odometer': 132609,
     'odometer_in_km': 213412,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2019-09-09',
     'sanitized_make': 'mini',
     'seller_name': 'dealer direct',
     'title': 'mini countryman hatchback 1.5 cooper s e classic all4 phev '
              '5dr auto',
     'transmission': 'automatic',
     'trim': '1.5 cooper s e classic all4 phev 5dr auto',
     'vin': None,
     'year': 2019}
{'auction_title': '',
 'c_o_2_emission_value': 43,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '8f111dc5-eecc-5b17-97e5-972164540f4c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FE69XTH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115431227',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'MINI',
 'model': 'COUNTRYMAN HATCHBACK',
 'odometer': 132609,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-09',
 'seller_name': 'Dealer Direct',
 'title': 'MINI COUNTRYMAN HATCHBACK 1.5 Cooper S E Classic ALL4 PHEV 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 Cooper S E Classic ALL4 PHEV 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115431227%27 HTTP/1.1" 200 None
2025-12-04 19:03:28 [astonbarclay.gb] INFO: Saving data for 115431227: {'auction_closing_time': 1765187100.0, 'created_time': 1758186113.099485, 'last_price_update_time': 1764875008.894178}
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115431227') HTTP/1.1" 204 0
2025-12-04 19:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6e6a9baf-a39a-5fac-90a5-976913c37793 with identifier: 116134889
2025-12-04 19:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6e6a9baf-a39a-5fac-90a5-976913c37793 with identifier: 116134889
2025-12-04 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 133837 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133837
2025-12-04 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 6e6a9baf-a39a-5fac-90a5-976913c37793 spider: astonbarclay.gb
2025-12-04 19:03:29 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6e6a9baf-a39a-5fac-90a5-976913c37793 due to rule: high_mileage_for_make.json, error: 133837 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    133837
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Diesel',
 'id': '6e6a9baf-a39a-5fac-90a5-976913c37793',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GK67LBN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116134889',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY DIESEL SW',
 'odometer': 83163,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-01',
 'seller_name': 'Zuto',
 'title': 'LAND ROVER DISCOVERY DIESEL SW 2.0 SD4 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 SD4 HSE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116134889%27 HTTP/1.1" 200 None
2025-12-04 19:03:29 [astonbarclay.gb] INFO: Saving data for 116134889: {'auction_closing_time': 1765187100.0, 'created_time': 1764097547.300321, 'last_price_update_time': 1764875009.12078}
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116134889') HTTP/1.1" 204 0
2025-12-04 19:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 49551844-e386-58cb-8bab-99fef48f4e98 with identifier: 117743322
2025-12-04 19:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 49551844-e386-58cb-8bab-99fef48f4e98 with identifier: 117743322
2025-12-04 19:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 49551844-e386-58cb-8bab-99fef48f4e98 with identifier: 117743322 to the API
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2749551844-e386-58cb-8bab-99fef48f4e98%27 HTTP/1.1" 200 None
2025-12-04 19:03:29 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 49551844-e386-58cb-8bab-99fef48f4e98: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:28 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117743322?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '49551844-e386-58cb-8bab-99fef48f4e98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ML18KWO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743322',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'C CLASS DIESEL COUPE',
 'odometer': 49048,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': 'Hatfields Group',
 'title': 'MERCEDES-BENZ C CLASS DIESEL COUPE C250d AMG Line Premium 2dr Auto',
 'transmission': 'automatic',
 'trim': 'C250d AMG Line Premium 2dr Auto',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743322%27 HTTP/1.1" 200 None
2025-12-04 19:03:29 [astonbarclay.gb] INFO: Saving data for 117743322: {'created_time': 1764875009.415902, 'last_price_update_time': 1764875009.415912, 'auction_closing_time': 1765285200.0}
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743322') HTTP/1.1" 204 0
2025-12-04 19:03:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117214904?view=catalogue)
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fb9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4790dd0>
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47ab790>
2025-12-04 19:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252Fd2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59fa5d0>
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6c234d0>
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a36d90>
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252F5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:30 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117288965, 'registration': 'EY19NTD', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 31053, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY19NTD/2025-11-18/image/bdc21242-4ef3-4ca6-bd22-28ae66f5cffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/60dc6fec-121d-4d1c-b3b9-3dee5396769b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/74e236b1-3cf4-4145-8b50-c46d10eb99d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/7c814446-abc8-492b-af08-e7985c8519e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/633362ed-0960-4475-8fc3-d5250f63ef03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/c0a6d51e-a6f9-4cd4-819d-089acffbe0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/5a168922-4644-4c5b-980c-63a0b67cd27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/18ca4595-060c-4750-93d3-7849d12bd93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/2b782fd1-97de-4707-a4c7-c40877e9c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/afb37653-20c4-473a-9bfc-d6a233e96b6c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/22 10K 12/23 15K 07/25 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d785b6f4-42ac-4fde-bfb4-9a8d9f86b71f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:30 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117288965, 'registration': 'EY19NTD', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T N-Connecta 5dr', 'mileage': 31053, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-31', 'fuel': 'Petrol', 'motExpiry': '2025-12-17', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EY19NTD/2025-11-18/image/bdc21242-4ef3-4ca6-bd22-28ae66f5cffa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/60dc6fec-121d-4d1c-b3b9-3dee5396769b_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/74e236b1-3cf4-4145-8b50-c46d10eb99d5_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/7c814446-abc8-492b-af08-e7985c8519e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/633362ed-0960-4475-8fc3-d5250f63ef03_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/c0a6d51e-a6f9-4cd4-819d-089acffbe0c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/5a168922-4644-4c5b-980c-63a0b67cd27f_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/18ca4595-060c-4750-93d3-7849d12bd93d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/2b782fd1-97de-4707-a4c7-c40877e9c653_removebg.jpg?w=600', 'https://abimg003.imgix.net/EY19NTD/2025-11-18/image/afb37653-20c4-473a-9bfc-d6a233e96b6c_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/22 10K 12/23 15K 07/25 29K', 'remarks': 'SKEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d785b6f4-42ac-4fde-bfb4-9a8d9f86b71f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-12-04 19:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 700bb410-50f1-5407-a07e-ce149793c990 with scrape type 2
2025-12-04 19:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 700bb410-50f1-5407-a07e-ce149793c990 with scrape type 2
2025-12-04 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 700bb410-50f1-5407-a07e-ce149793c990, identifier: 117288965
2025-12-04 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117661782, 'registration': 'AX19EOB', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 35092, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/20 5K 09/21 8K 11/22 11K 01/23 12K 08/23 16K 11/24 26K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4dd893e7-5ec9-419a-905b-d4684116233f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117661782, 'registration': 'AX19EOB', 'account': 'KCS002', 'make': 'HYUNDAI', 'model': 'KONA HATCHBACK', 'derivative': '1.0T GDi Blue Drive Premium 5dr', 'mileage': 35092, 'mileageWarranty': True, 'type': 'car', 'saleId': 18000, 'siteId': 659780, 'site': {'id': 659780, 'name': 'Aston Barclay Westbury', 'vehicles': 104}, 'saleStart': '2025-12-08T09:45Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-03-27', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AX19EOB/2025-12-02/image/deb87879-6401-4fe6-a708-c0cac2c0bc0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ecc7fb15-e6b4-4f9c-868e-b094b8092f74_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/40f6bcd2-1ff9-4d7c-8035-22aea9e6b361_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/744e863e-1b5f-486b-a867-6d07a6fe24e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/ea46bbf0-2291-4923-991a-e4d7ec889044_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/cbc6017d-c189-43ca-8bc7-5235cfaf0482_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/5536dae1-42da-4d30-b9cc-122f425aba6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/288effb1-8abc-41d4-8a07-d2e858165642_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/96e1bdc1-e777-490e-8d10-8846db4f4257_removebg.jpg?w=600', 'https://abimg003.imgix.net/AX19EOB/2025-12-02/image/f4187a4f-ffa5-477b-996f-26133ae180da_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/20 5K 09/21 8K 11/22 11K 01/23 12K 08/23 16K 11/24 26K', 'remarks': 'S/KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 127, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/4dd893e7-5ec9-419a-905b-d4684116233f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-04 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with scrape type 2
2025-12-04 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with scrape type 2
2025-12-04 19:03:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7, identifier: 117661782
2025-12-04 19:03:31 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117743313, 'registration': 'YY18OFW', 'account': 'HAT006', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI 184 GTD 5dr DSG', 'mileage': 39172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-05-17', 'fuel': 'Diesel', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**4**VOSA STATES 15K, 19K, 24K, 29K, 35K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:31 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117743313, 'registration': 'YY18OFW', 'account': 'HAT006', 'make': 'VOLKSWAGEN', 'model': 'GOLF DIESEL HATCHBACK', 'derivative': '2.0 TDI 184 GTD 5dr DSG', 'mileage': 39172, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-05-17', 'fuel': 'Diesel', 'motExpiry': '2026-05-16', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Hatchback', 'images': None, 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': '**4**VOSA STATES 15K, 19K, 24K, 29K, 35K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': None, 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e036979d-dd16-575e-b3ff-28a4e170b8e4 with identifier: 117743313
2025-12-04 19:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e036979d-dd16-575e-b3ff-28a4e170b8e4 with scrape type 1
2025-12-04 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item e036979d-dd16-575e-b3ff-28a4e170b8e4
2025-12-04 19:03:31 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item e036979d-dd16-575e-b3ff-28a4e170b8e4
2025-12-04 19:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: e036979d-dd16-575e-b3ff-28a4e170b8e4, identifier: 117743313
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fd4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-12-04 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965
2025-12-04 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 700bb410-50f1-5407-a07e-ce149793c990 with identifier: 117288965 to the API
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27700bb410-50f1-5407-a07e-ce149793c990%27 HTTP/1.1" 200 None
2025-12-04 19:03:32 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 700bb410-50f1-5407-a07e-ce149793c990: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:31 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288965?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '700bb410-50f1-5407-a07e-ce149793c990',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EY19NTD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288965',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 31053,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288965%27 HTTP/1.1" 200 None
2025-12-04 19:03:32 [astonbarclay.gb] INFO: Saving data for 117288965: {'auction_closing_time': 1765187100.0, 'created_time': 1763456563.736356, 'last_price_update_time': 1764875012.439247}
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288965') HTTP/1.1" 204 0
2025-12-04 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-04 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782
2025-12-04 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: cb33cba7-fde2-51bb-8ef6-46e67c9a30f7 with identifier: 117661782 to the API
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117661782?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'cb33cba7-fde2-51bb-8ef6-46e67c9a30f7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AX19EOB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117661782',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'KONA HATCHBACK',
 'odometer': 35092,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-27',
 'seller_name': 'TCB Group - Prime',
 'title': 'HYUNDAI KONA HATCHBACK 1.0T GDi Blue Drive Premium 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi Blue Drive Premium 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117661782%27 HTTP/1.1" 200 None
2025-12-04 19:03:32 [astonbarclay.gb] INFO: Saving data for 117661782: {'auction_closing_time': 1765187100.0, 'created_time': 1764702150.081366, 'last_price_update_time': 1764875012.759224}
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117661782') HTTP/1.1" 204 0
2025-12-04 19:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: e036979d-dd16-575e-b3ff-28a4e170b8e4 with identifier: 117743313
2025-12-04 19:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: e036979d-dd16-575e-b3ff-28a4e170b8e4 with identifier: 117743313
2025-12-04 19:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: e036979d-dd16-575e-b3ff-28a4e170b8e4 with identifier: 117743313 to the API
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27e036979d-dd16-575e-b3ff-28a4e170b8e4%27 HTTP/1.1" 200 None
2025-12-04 19:03:33 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id e036979d-dd16-575e-b3ff-28a4e170b8e4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:32 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117743313?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'e036979d-dd16-575e-b3ff-28a4e170b8e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY18OFW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117743313',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF DIESEL HATCHBACK',
 'odometer': 39172,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-17',
 'seller_name': 'Hatfields Group',
 'title': 'VOLKSWAGEN GOLF DIESEL HATCHBACK 2.0 TDI 184 GTD 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI 184 GTD 5dr DSG',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117743313%27 HTTP/1.1" 200 None
2025-12-04 19:03:33 [astonbarclay.gb] INFO: Saving data for 117743313: {'created_time': 1764875013.060812, 'last_price_update_time': 1764875013.060823, 'auction_closing_time': 1765285200.0}
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117743313') HTTP/1.1" 204 0
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F664c68b5-a624-403b-ad65-def33b712824_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117741358?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117748030?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116509919?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117767695?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539813?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a1d310>
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOH04ALH%252F2025-11-27%252Fimage%252Fa9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dfc655be-8013-5d77-ac9c-c7550de27caf
2025-12-04 19:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dfc655be-8013-5d77-ac9c-c7550de27caf, skipping ID generation
2025-12-04 19:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfc655be-8013-5d77-ac9c-c7550de27caf with scrape type 1
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Removing item dfc655be-8013-5d77-ac9c-c7550de27caf from tracking dictionaries
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dfc655be-8013-5d77-ac9c-c7550de27caf sending to next pipeline
2025-12-04 19:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: dfc655be-8013-5d77-ac9c-c7550de27caf, identifier: 117214904
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: dfc655be-8013-5d77-ac9c-c7550de27caf with identifier: 117214904
2025-12-04 19:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: dfc655be-8013-5d77-ac9c-c7550de27caf with identifier: 117214904
2025-12-04 19:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: dfc655be-8013-5d77-ac9c-c7550de27caf with identifier: 117214904 to the API
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 101,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'dfc655be-8013-5d77-ac9c-c7550de27caf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OH04ALH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117214904',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'VOLKSWAGEN',
 'model': 'POLO HATCHBACK',
 'odometer': 54191,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22884,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/a9d0f787-15d5-46c3-9ea0-1840797363d0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 21571,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86adb90c-4809-453e-9f5a-9a3bd6021754_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22856,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/39d6c083-f386-424e-a303-4c1d2c65cbbe_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23056,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/9c97e83d-33b5-4af2-975c-cbb7d581a29f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40243,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/d2cb2d41-9f49-43f9-8edb-2b35a7133706_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84052,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/5c9b5869-b869-4b4e-9e7c-c5a8c9a4339a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81436,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/097fef15-6704-4fbc-8502-1a559a66f357_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 47976,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/86d8aca5-abcd-429c-ac98-ead71643ea4d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dfc655be-8013-5d77-ac9c-c7550de27caf/dfc655be-8013-5d77-ac9c-c7550de27caf_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43918,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OH04ALH/2025-11-27/image/0e9b3476-5b9e-4a1d-b9f3-bf9b2af3a0fb_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-30',
 'seller_name': 'MotoNovo Finance',
 'title': 'VOLKSWAGEN POLO HATCHBACK 1.0 TSI 95 SE 5dr',
 'transmission': 'manual',
 'trim': '1.0 TSI 95 SE 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117214904%27 HTTP/1.1" 200 None
2025-12-04 19:03:33 [astonbarclay.gb] INFO: Saving data for 117214904: {'created_time': 1764875013.867215, 'last_price_update_time': 1764875013.867224, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117214904') HTTP/1.1" 204 0
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fa59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117079065?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f91490>
2025-12-04 19:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F567090c6-f121-494a-903f-b82732077fc7_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117741358, 'registration': 'YY67TLZ', 'account': 'HAT002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 150 SE Nav 5dr DSG', 'mileage': 70703, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-02-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/20 - 20K, 11/22 - 31K, 08/23 - 41K, 03/24 - 50K,', 'remarks': '**126**VOSA STATES 20K, 25K, 31K, 43K, 62K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117741358, 'registration': 'YY67TLZ', 'account': 'HAT002', 'make': 'VOLKSWAGEN', 'model': 'TIGUAN DIESEL ESTATE', 'derivative': '2.0 TDi 150 SE Nav 5dr DSG', 'mileage': 70703, 'mileageWarranty': True, 'type': 'car', 'saleId': 17901, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-12-07', 'fuel': 'Diesel', 'motExpiry': '2026-02-02', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': None, 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print 11/20 - 20K, 11/22 - 31K, 08/23 - 41K, 03/24 - 50K,', 'remarks': '**126**VOSA STATES 20K, 25K, 31K, 43K, 62K SD CARD', 'virtual': False, 'seller': 'Hatfields Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5e73cb0a-a55b-5378-83de-d700387f7e34 with identifier: 117741358
2025-12-04 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5e73cb0a-a55b-5378-83de-d700387f7e34 with scrape type 1
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item 5e73cb0a-a55b-5378-83de-d700387f7e34
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item 5e73cb0a-a55b-5378-83de-d700387f7e34
2025-12-04 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5e73cb0a-a55b-5378-83de-d700387f7e34, identifier: 117741358
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117748030, 'registration': 'LV17USH', 'account': 'SPE034', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr Xtronic', 'mileage': 41856, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and normal wear VOSA STATES 15K, 20K, 26K, 30K, 35K, 37K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117748030, 'registration': 'LV17USH', 'account': 'SPE034', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T N-Connecta 5dr Xtronic', 'mileage': 41856, 'mileageWarranty': False, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2017-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': None, 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': '', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and normal wear VOSA STATES 15K, 20K, 26K, 30K, 35K, 37K', 'virtual': False, 'seller': 'SVP Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b209c169-624d-5bf4-8d80-92d0c1e361db with identifier: 117748030
2025-12-04 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b209c169-624d-5bf4-8d80-92d0c1e361db with scrape type 1
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item b209c169-624d-5bf4-8d80-92d0c1e361db
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item b209c169-624d-5bf4-8d80-92d0c1e361db
2025-12-04 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b209c169-624d-5bf4-8d80-92d0c1e361db, identifier: 117748030
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116509919, 'registration': 'RF68MVX', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 94873, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8f457cc4-f9b8-4df7-bd64-b42679e491ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/5a524104-17a0-4797-a00f-1daa80ae636f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/50858f85-720e-4a69-b59c-acf469e44043_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/c15f399e-11a3-4b38-87f2-1f69dcbadbba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/ddd6411b-433d-440c-942a-642e9deb33f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/b0e0e535-64d1-4151-80b9-c17b6f259e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/399583bc-cbf5-49db-b910-3e43fa040bdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8a56da56-0f18-4e8d-bd09-a91db9925feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/48b7aea6-0ee4-4385-93a1-af9ab97b2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/00701a56-fcc7-4d64-ba41-d9e05a1f4d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/962b2777-0025-4eac-99e8-6bd4da4c3f3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19- 18K, 07/21- 36K, 11/21- 43K', 'remarks': 'VOSA STATES 54K, 73K, 85K, 94K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d0f70d5-3e01-430b-b578-4801a56ea9c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116509919, 'registration': 'RF68MVX', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES HATCHBACK', 'derivative': '118i [1.5] Sport 5dr [Nav/Servotronic]', 'mileage': 94873, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-12-17', 'fuel': 'Petrol', 'motExpiry': '2026-10-27', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8f457cc4-f9b8-4df7-bd64-b42679e491ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/5a524104-17a0-4797-a00f-1daa80ae636f_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/50858f85-720e-4a69-b59c-acf469e44043_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/c15f399e-11a3-4b38-87f2-1f69dcbadbba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/ddd6411b-433d-440c-942a-642e9deb33f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/b0e0e535-64d1-4151-80b9-c17b6f259e02_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/399583bc-cbf5-49db-b910-3e43fa040bdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/8a56da56-0f18-4e8d-bd09-a91db9925feb_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/48b7aea6-0ee4-4385-93a1-af9ab97b2984_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/00701a56-fcc7-4d64-ba41-d9e05a1f4d0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RF68MVX/2025-10-23/image/962b2777-0025-4eac-99e8-6bd4da4c3f3e_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital 10/19- 18K, 07/21- 36K, 11/21- 43K', 'remarks': 'VOSA STATES 54K, 73K, 85K, 94K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 137, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6d0f70d5-3e01-430b-b578-4801a56ea9c6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-04 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a343d5c-f504-59ea-ae64-b3f80d779d1d with scrape type 2
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a343d5c-f504-59ea-ae64-b3f80d779d1d with scrape type 2
2025-12-04 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2a343d5c-f504-59ea-ae64-b3f80d779d1d, identifier: 116509919
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117767695, 'registration': 'WK66TTX', 'account': 'STA058', 'make': 'VOLKSWAGEN', 'model': 'PASSAT DIESEL SALOON', 'derivative': '2.0 TDI SE Business 4dr DSG', 'mileage': 104883, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-10-12', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 10/17 - 19K, 09/19 - 45K, 03/21 - 45K, 02/22 - 66K, 06/23 - 84K,', 'remarks': '**1650**VOSA STATES 45K, 45K, 49K, 59K, 73K, 84K, 93K, 102K SD CARD', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117767695, 'registration': 'WK66TTX', 'account': 'STA058', 'make': 'VOLKSWAGEN', 'model': 'PASSAT DIESEL SALOON', 'derivative': '2.0 TDI SE Business 4dr DSG', 'mileage': 104883, 'mileageWarranty': True, 'type': 'car', 'saleId': 17900, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-09T13:00Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-10-12', 'fuel': 'Diesel', 'motExpiry': '2026-06-06', 'doors': 4, 'engineSize': 1968, 'bodyType': 'Saloon', 'images': None, 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': None, 'serviceHistory': 'Service print and book 10/17 - 19K, 09/19 - 45K, 03/21 - 45K, 02/22 - 66K, 06/23 - 84K,', 'remarks': '**1650**VOSA STATES 45K, 45K, 49K, 59K, 73K, 84K, 93K, 102K SD CARD', 'virtual': False, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc93b605-8079-599a-9c2a-ffa942d3153c with identifier: 117767695
2025-12-04 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc93b605-8079-599a-9c2a-ffa942d3153c with scrape type 1
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 0 photos for item bc93b605-8079-599a-9c2a-ffa942d3153c
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: No photos to download for item bc93b605-8079-599a-9c2a-ffa942d3153c
2025-12-04 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: bc93b605-8079-599a-9c2a-ffa942d3153c, identifier: 117767695
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539813, 'registration': 'LC74SFU', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 10991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-10-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LC74SFU/2025-11-29/image/70b57690-e276-4190-8af2-79ef6ddc123a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/c17b4c72-96b0-47ad-8b7b-4e1131a9175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fb5cb6b0-f74d-4fe3-9a2e-85d3cec041cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fae448be-5ce8-4cdf-b17f-420b21ec6c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/666d649d-cfb3-4dcd-b45a-a597f0740be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/d0366e2b-e3a6-4b8c-b91c-8b9a1a3a751a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/147d070b-9409-4aab-aa2b-b8474cb5d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/ac4070b0-15b0-44e3-a504-c79cdf2f0d16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/bcf764a3-03a8-4c23-be40-8f6fad5d048d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/25- 10K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9106f0d-4bab-4800-b575-dcc0384eda24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539813, 'registration': 'LC74SFU', 'account': 'THE109', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Excite 5dr', 'mileage': 10991, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2024-10-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LC74SFU/2025-11-29/image/70b57690-e276-4190-8af2-79ef6ddc123a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/c17b4c72-96b0-47ad-8b7b-4e1131a9175e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fb5cb6b0-f74d-4fe3-9a2e-85d3cec041cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/fae448be-5ce8-4cdf-b17f-420b21ec6c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/666d649d-cfb3-4dcd-b45a-a597f0740be6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/d0366e2b-e3a6-4b8c-b91c-8b9a1a3a751a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/147d070b-9409-4aab-aa2b-b8474cb5d07f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/ac4070b0-15b0-44e3-a504-c79cdf2f0d16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LC74SFU/2025-11-29/image/bcf764a3-03a8-4c23-be40-8f6fad5d048d_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 11/25- 10K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a9106f0d-4bab-4800-b575-dcc0384eda24.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-04 19:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with scrape type 2
2025-12-04 19:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with scrape type 2
2025-12-04 19:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762, identifier: 117539813
2025-12-04 19:03:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5e73cb0a-a55b-5378-83de-d700387f7e34 with identifier: 117741358
2025-12-04 19:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5e73cb0a-a55b-5378-83de-d700387f7e34 with identifier: 117741358
2025-12-04 19:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 5e73cb0a-a55b-5378-83de-d700387f7e34 with identifier: 117741358 to the API
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%275e73cb0a-a55b-5378-83de-d700387f7e34%27 HTTP/1.1" 200 None
2025-12-04 19:03:34 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 5e73cb0a-a55b-5378-83de-d700387f7e34: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117741358?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '5e73cb0a-a55b-5378-83de-d700387f7e34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY67TLZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117741358',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'TIGUAN DIESEL ESTATE',
 'odometer': 70703,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-12-07',
 'seller_name': 'Hatfields Group',
 'title': 'VOLKSWAGEN TIGUAN DIESEL ESTATE 2.0 TDi 150 SE Nav 5dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDi 150 SE Nav 5dr DSG',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117741358%27 HTTP/1.1" 200 None
2025-12-04 19:03:34 [astonbarclay.gb] INFO: Saving data for 117741358: {'created_time': 1764875014.965689, 'last_price_update_time': 1764875014.9657, 'auction_closing_time': 1765285200.0}
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117741358') HTTP/1.1" 204 0
2025-12-04 19:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b209c169-624d-5bf4-8d80-92d0c1e361db with identifier: 117748030
2025-12-04 19:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b209c169-624d-5bf4-8d80-92d0c1e361db with identifier: 117748030
2025-12-04 19:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b209c169-624d-5bf4-8d80-92d0c1e361db with identifier: 117748030 to the API
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27b209c169-624d-5bf4-8d80-92d0c1e361db%27 HTTP/1.1" 200 None
2025-12-04 19:03:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id b209c169-624d-5bf4-8d80-92d0c1e361db: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:34 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117748030?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b209c169-624d-5bf4-8d80-92d0c1e361db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LV17USH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117748030',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 41856,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-31',
 'seller_name': 'SVP Ltd',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T N-Connecta 5dr Xtronic',
 'transmission': 'automatic',
 'trim': '1.2 DiG-T N-Connecta 5dr Xtronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117748030%27 HTTP/1.1" 200 None
2025-12-04 19:03:35 [astonbarclay.gb] INFO: Saving data for 117748030: {'created_time': 1764875015.274624, 'last_price_update_time': 1764875015.274634, 'auction_closing_time': 1765285200.0}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117748030') HTTP/1.1" 204 0
2025-12-04 19:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d with identifier: 116509919
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152682
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 2a343d5c-f504-59ea-ae64-b3f80d779d1d spider: astonbarclay.gb
2025-12-04 19:03:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 2a343d5c-f504-59ea-ae64-b3f80d779d1d due to rule: high_mileage_for_country.json, error: 152682 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152682
{'auction_title': '',
 'c_o_2_emission_value': 137,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2a343d5c-f504-59ea-ae64-b3f80d779d1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RF68MVX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116509919',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 94873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-17',
 'seller_name': 'CarGiant',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] Sport 5dr [Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '118i [1.5] Sport 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116509919%27 HTTP/1.1" 200 None
2025-12-04 19:03:35 [astonbarclay.gb] INFO: Saving data for 116509919: {'auction_closing_time': 1764936000.0, 'created_time': 1761037275.386796, 'last_price_update_time': 1764875015.489692}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116509919') HTTP/1.1" 204 0
2025-12-04 19:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: bc93b605-8079-599a-9c2a-ffa942d3153c with identifier: 117767695
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: bc93b605-8079-599a-9c2a-ffa942d3153c with identifier: 117767695
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168792 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168792
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: bc93b605-8079-599a-9c2a-ffa942d3153c spider: astonbarclay.gb
2025-12-04 19:03:35 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: bc93b605-8079-599a-9c2a-ffa942d3153c due to rule: high_mileage_for_country.json, error: 168792 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168792
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-09T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'bc93b605-8079-599a-9c2a-ffa942d3153c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WK66TTX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117767695',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'VOLKSWAGEN',
 'model': 'PASSAT DIESEL SALOON',
 'odometer': 104883,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'VOLKSWAGEN PASSAT DIESEL SALOON 2.0 TDI SE Business 4dr DSG',
 'transmission': 'automatic',
 'trim': '2.0 TDI SE Business 4dr DSG',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117767695%27 HTTP/1.1" 200 None
2025-12-04 19:03:35 [astonbarclay.gb] INFO: Saving data for 117767695: {'created_time': 1764875015.70982, 'last_price_update_time': 1764875015.70983, 'auction_closing_time': 1765285200.0}
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117767695') HTTP/1.1" 204 0
2025-12-04 19:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-04 19:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813
2025-12-04 19:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fdb2fdc2-a124-5806-b72d-0aa1cb2e9762 with identifier: 117539813 to the API
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fdb2fdc2-a124-5806-b72d-0aa1cb2e9762%27 HTTP/1.1" 200 None
2025-12-04 19:03:35 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fdb2fdc2-a124-5806-b72d-0aa1cb2e9762: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:35 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117539813?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': 'fdb2fdc2-a124-5806-b72d-0aa1cb2e9762',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LC74SFU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539813',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 10991,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-10-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Excite 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Excite 5dr',
 'vin': None,
 'year': 2024}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539813%27 HTTP/1.1" 200 None
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Saving data for 117539813: {'auction_closing_time': 1765215000.0, 'created_time': 1764356773.151338, 'last_price_update_time': 1764875016.014426}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539813') HTTP/1.1" 204 0
2025-12-04 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117569819?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 30K 30K', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117276677, 'registration': 'LP19RXL', 'account': 'SOU037', 'make': 'VAUXHALL', 'model': 'ASTRA HATCHBACK', 'derivative': '1.0T ecoTEC Elite Nav 5dr', 'mileage': 31105, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-05-22', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LP19RXL/2025-11-18/image/7c43d681-7f13-42dc-b0d4-934c44c04ab0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/51a43a15-b093-41f1-a854-dd2eeae9452b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/21c4de07-50d4-4094-8e4c-d8aa06ba8e5a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/134999b7-7f0f-4a53-ad71-0d08023791eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/54740b1b-9aba-494a-aafc-636cc0f1a8eb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/17b6e06a-67c2-4b70-a094-b6f7af3f1fdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/c7944ae5-0eba-47da-8f24-2afb0c9957e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP19RXL/2025-11-18/image/989087b9-4427-436a-a063-fce6611165ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 06/21-19K 10/22-28K 05/24-30K 05/25-30K', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 28K 30K 30K', 'virtual': False, 'seller': 'Local Dealer Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 110, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f18308b6-7d41-45ca-b7b9-c0d3823e2c66.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-04 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-12-04 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with scrape type 2
2025-12-04 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d, identifier: 117276677
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117079065, 'registration': 'CU19XNC', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [110] Elite Nav 5dr [Start Stop] Auto', 'mileage': 66357, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CU19XNC/2025-11-11/image/23b2f51e-7b4a-4e69-8191-54ff4377ee27_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/eff1c07c-701c-48a8-b39a-5b286f3d7ae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/e89c2db8-e314-4ab2-8f4c-4342c392e94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/ce4b833e-47f9-4c5f-8f7d-645f08f691ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/dabb23ac-89cf-446a-a12f-9f41dfe36bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/1d9949a8-87e0-4b75-a4e4-00df05a873c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/f1b0f023-abfd-4498-9d35-ad5ffc6e96b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/af45f735-9d10-41e9-83cb-b32bc0b011af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/49b71a9d-3e78-4327-a084-99c8c64a6ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/d0431ab4-be1b-4134-bdd8-5a1efc050594_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-11k,  04/21-17k,  03/22-29,', 'remarks': 'SPARE KEY, VOSA STATES 29K 39K 56K 63K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d9308124-5405-4035-b3b7-5a1053de6b26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117079065, 'registration': 'CU19XNC', 'account': 'ZUT001', 'make': 'VAUXHALL', 'model': 'CROSSLAND X HATCHBACK', 'derivative': '1.2T [110] Elite Nav 5dr [Start Stop] Auto', 'mileage': 66357, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-04-08', 'fuel': 'Petrol', 'motExpiry': '2025-09-23', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CU19XNC/2025-11-11/image/23b2f51e-7b4a-4e69-8191-54ff4377ee27_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/eff1c07c-701c-48a8-b39a-5b286f3d7ae7_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/e89c2db8-e314-4ab2-8f4c-4342c392e94b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/ce4b833e-47f9-4c5f-8f7d-645f08f691ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/dabb23ac-89cf-446a-a12f-9f41dfe36bdd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/1d9949a8-87e0-4b75-a4e4-00df05a873c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/f1b0f023-abfd-4498-9d35-ad5ffc6e96b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/af45f735-9d10-41e9-83cb-b32bc0b011af_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/49b71a9d-3e78-4327-a084-99c8c64a6ea5_removebg.jpg?w=600', 'https://abimg003.imgix.net/CU19XNC/2025-11-11/image/d0431ab4-be1b-4134-bdd8-5a1efc050594_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 08/20-11k,  04/21-17k,  03/22-29,', 'remarks': 'SPARE KEY, VOSA STATES 29K 39K 56K 63K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d9308124-5405-4035-b3b7-5a1053de6b26.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-04 19:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with scrape type 2
2025-12-04 19:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with scrape type 2
2025-12-04 19:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d873c126-6db5-56fc-8c00-0dd2dc4f08d9, identifier: 117079065
2025-12-04 19:03:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-04 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677
2025-12-04 19:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4a42e05e-1cce-5cf2-8f88-23b89a32ba9d with identifier: 117276677 to the API
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117276677?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '4a42e05e-1cce-5cf2-8f88-23b89a32ba9d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP19RXL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117276677',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'ASTRA HATCHBACK',
 'odometer': 31105,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-22',
 'seller_name': 'Local Dealer Group',
 'title': 'VAUXHALL ASTRA HATCHBACK 1.0T ecoTEC Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.0T ecoTEC Elite Nav 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117276677%27 HTTP/1.1" 200 None
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Saving data for 117276677: {'auction_closing_time': 1764936000.0, 'created_time': 1763492979.845664, 'last_price_update_time': 1764875016.570021}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117276677') HTTP/1.1" 204 0
2025-12-04 19:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-04 19:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065
2025-12-04 19:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d873c126-6db5-56fc-8c00-0dd2dc4f08d9 with identifier: 117079065 to the API
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117079065?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd873c126-6db5-56fc-8c00-0dd2dc4f08d9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CU19XNC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117079065',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VAUXHALL',
 'model': 'CROSSLAND X HATCHBACK',
 'odometer': 66357,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-08',
 'seller_name': 'Zuto',
 'title': 'VAUXHALL CROSSLAND X HATCHBACK 1.2T [110] Elite Nav 5dr [Start '
          'Stop] Auto',
 'transmission': 'automatic',
 'trim': '1.2T [110] Elite Nav 5dr [Start Stop] Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117079065%27 HTTP/1.1" 200 None
2025-12-04 19:03:36 [astonbarclay.gb] INFO: Saving data for 117079065: {'auction_closing_time': 1764936000.0, 'created_time': 1764097470.44529, 'last_price_update_time': 1764875016.886689}
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117079065') HTTP/1.1" 204 0
2025-12-04 19:03:36 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:36 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a72c90>
2025-12-04 19:03:36 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fb9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117023522?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117480843?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117073655?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117121221?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662789?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117749600?view=catalogue)
2025-12-04 19:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c3e950>
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F664c68b5-a624-403b-ad65-def33b712824_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4826e90>
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252F1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a3cf50>
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fd4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:37 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS003', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CP68LNV/2025-11-28/image/c9c35042-6dd2-48a4-bf35-dc3218604485_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ec56e20-93af-4229-ab80-11fcce2f4415_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/49af51c2-3def-4735-9070-0992b86eb4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/18d4024d-abcb-4d3a-909a-925d175631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/65a739f8-0791-4d56-bcf9-fb6e60e58f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ad449ed-c1dd-442e-9f06-8e65d07bfc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/931dce1e-eb18-4eb7-a5a2-5c384a7d6d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/d4043e23-54b3-42f2-938b-92098f105dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/7433a850-67e3-4fa4-af28-9ea587aae826_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/19 21K- 03/22 61K- 02/23 79K - 09/25 101K', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:37 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117569819, 'registration': 'CP68LNV', 'account': 'KCS003', 'make': 'SKODA', 'model': 'KODIAQ ESTATE', 'derivative': '1.5 TSI SE L 5dr DSG [7 Seat]', 'mileage': 106414, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-11-21', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/CP68LNV/2025-11-28/image/c9c35042-6dd2-48a4-bf35-dc3218604485_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ec56e20-93af-4229-ab80-11fcce2f4415_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/49af51c2-3def-4735-9070-0992b86eb4c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/18d4024d-abcb-4d3a-909a-925d175631e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/65a739f8-0791-4d56-bcf9-fb6e60e58f0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/9ad449ed-c1dd-442e-9f06-8e65d07bfc74_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/931dce1e-eb18-4eb7-a5a2-5c384a7d6d6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/d4043e23-54b3-42f2-938b-92098f105dcd_removebg.jpg?w=600', 'https://abimg003.imgix.net/CP68LNV/2025-11-28/image/7433a850-67e3-4fa4-af28-9ea587aae826_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print 11/19 21K- 03/22 61K- 02/23 79K - 09/25 101K', 'remarks': 'VOSA STATES 76K - 94K - 101K - 106K', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 143, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/65964909-b959-4c1e-9a4b-e2653e98ffe5.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-04 19:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with scrape type 2
2025-12-04 19:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d, identifier: 117569819
2025-12-04 19:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-04 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d with identifier: 117569819
2025-12-04 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
2025-12-04 19:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d spider: astonbarclay.gb
2025-12-04 19:03:38 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d due to rule: high_mileage_for_country.json, error: 171256 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171256
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '74f1b3af-a32a-5e1a-b916-4f2fc1b61f8d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CP68LNV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117569819',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SKODA',
 'model': 'KODIAQ ESTATE',
 'odometer': 106414,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-12-28',
 'seller_name': 'CarBuy Lltd',
 'title': 'SKODA KODIAQ ESTATE 1.5 TSI SE L 5dr DSG [7 Seat]',
 'transmission': 'automatic',
 'trim': '1.5 TSI SE L 5dr DSG [7 Seat]',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117569819%27 HTTP/1.1" 200 None
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Saving data for 117569819: {'auction_closing_time': 1764936000.0, 'created_time': 1764270101.440459, 'last_price_update_time': 1764875018.202736}
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117569819') HTTP/1.1" 204 0
2025-12-04 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117217399?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117455255?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117023522, 'registration': 'YS70PZX', 'account': 'LPK001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro S Line 5dr S Tronic', 'mileage': 98834, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-12-04', 'fuel': 'Diesel', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS70PZX/2025-11-11/image/badca98f-11e3-421a-85f9-8596dca9e9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/9be31c82-bfcd-44d4-98ee-3632c6891302_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/69f6e28d-b781-45ba-a72b-ea965895ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/71d271ef-3bb6-48cc-87d5-78e471ab033f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca15ca06-51b3-4819-94f7-d3cbbdd87e7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca65eb6c-3f51-45e2-90c9-736bd43c1dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ee9d1036-3d80-4f62-8b20-b4b11bf2ecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/383276a2-ff75-4048-8562-29b75f590141_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/579a351c-550d-48b7-b102-8f45f1852595_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/df83dd58-634e-477b-9131-c283dcf90331_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 5/21 14K, 11/21 23K, 4/22 31K, 8/22 39K, 11/22 44K, 2/23 47K, 8/23 58K, 12/23 64K, 2/24 67K, 11/24 87K, 6/25 97K', 'remarks': 'VOSA STATES 64K, 87K, SPARE KEY IN OFFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5592c627-e38b-4129-8dc4-4f98f555d4ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117023522, 'registration': 'YS70PZX', 'account': 'LPK001', 'make': 'AUDI', 'model': 'Q5 DIESEL ESTATE', 'derivative': '40 TDI Quattro S Line 5dr S Tronic', 'mileage': 98834, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2020-12-04', 'fuel': 'Diesel', 'motExpiry': '2025-12-11', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YS70PZX/2025-11-11/image/badca98f-11e3-421a-85f9-8596dca9e9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/9be31c82-bfcd-44d4-98ee-3632c6891302_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/69f6e28d-b781-45ba-a72b-ea965895ef5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/71d271ef-3bb6-48cc-87d5-78e471ab033f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca15ca06-51b3-4819-94f7-d3cbbdd87e7a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ca65eb6c-3f51-45e2-90c9-736bd43c1dde_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/ee9d1036-3d80-4f62-8b20-b4b11bf2ecc9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/383276a2-ff75-4048-8562-29b75f590141_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/579a351c-550d-48b7-b102-8f45f1852595_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS70PZX/2025-11-11/image/df83dd58-634e-477b-9131-c283dcf90331_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 5/21 14K, 11/21 23K, 4/22 31K, 8/22 39K, 11/22 44K, 2/23 47K, 8/23 58K, 12/23 64K, 2/24 67K, 11/24 87K, 6/25 97K', 'remarks': 'VOSA STATES 64K, 87K, SPARE KEY IN OFFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 171, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5592c627-e38b-4129-8dc4-4f98f555d4ba.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 08637a26-6b6d-5217-8eb1-7c440a9fcc73, identifier: 117023522
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117480843, 'registration': 'EN67GHH', 'account': 'SEL005', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Dynamique S Nav 5dr', 'mileage': 81617, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-31', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN67GHH/2025-12-02/image/3da7f911-caac-4732-9b8d-4d5d876d8367_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/94980b29-3f80-47c1-8f51-4de28fbffa89_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/5c6e571d-0153-4ff8-b0e6-0b404e1f4ceb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/cb0209c0-d4c1-48af-9d00-bd0819168d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/8451f195-9585-45fc-b7f1-f5949c0019aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/f31c8364-df5f-4e62-b2ac-48fa5c9f0182_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/80e5a7dc-6c56-4060-be85-d22f9cff2fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/b1b4b1d3-5886-45a9-8cdb-2a791a5d029d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/428cfe33-62be-4779-9622-81c0c3d0b1d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/c6c07efd-15ea-4498-abb6-30df17ad1e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/adbddee0-d38d-4a81-9dd4-90e6f38145de_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/5f980212-d045-4c42-8334-0e90748b7ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/781d728a-4762-4d09-9d37-a1418500a5bd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19 11K - 08/19 18K - 02/20 18K - 06/23 58K', 'remarks': 'VOSA STATES 46K- 55K- 64K- 75K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76b42130-b3ab-4f83-b61c-097345ef1bcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117480843, 'registration': 'EN67GHH', 'account': 'SEL005', 'make': 'RENAULT', 'model': 'KADJAR DIESEL HATCHBACK', 'derivative': '1.5 dCi Dynamique S Nav 5dr', 'mileage': 81617, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-01-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-31', 'doors': 5, 'engineSize': 1461, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/EN67GHH/2025-12-02/image/3da7f911-caac-4732-9b8d-4d5d876d8367_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/94980b29-3f80-47c1-8f51-4de28fbffa89_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/5c6e571d-0153-4ff8-b0e6-0b404e1f4ceb_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/cb0209c0-d4c1-48af-9d00-bd0819168d24_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/8451f195-9585-45fc-b7f1-f5949c0019aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/f31c8364-df5f-4e62-b2ac-48fa5c9f0182_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/80e5a7dc-6c56-4060-be85-d22f9cff2fa0_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/b1b4b1d3-5886-45a9-8cdb-2a791a5d029d_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/428cfe33-62be-4779-9622-81c0c3d0b1d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/c6c07efd-15ea-4498-abb6-30df17ad1e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/adbddee0-d38d-4a81-9dd4-90e6f38145de_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/5f980212-d045-4c42-8334-0e90748b7ef3_removebg.jpg?w=600', 'https://abimg003.imgix.net/EN67GHH/2025-12-02/image/781d728a-4762-4d09-9d37-a1418500a5bd_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 01/19 11K - 08/19 18K - 02/20 18K - 06/23 58K', 'remarks': 'VOSA STATES 46K- 55K- 64K- 75K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 103, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/76b42130-b3ab-4f83-b61c-097345ef1bcd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 with identifier: 117480843
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3, identifier: 117480843
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117073655, 'registration': 'LR17FME', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d AMG Line 4dr 9G-Tronic', 'mileage': 86916, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LR17FME/2025-11-10/image/30231d22-18e1-4b78-9d49-c0add20dc67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/2fb04e9f-a99e-4c08-967c-9ee854f5e4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/81666646-91c1-4aac-8e08-ad65ea9c9484_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/301fec2f-6884-4dd8-bbf7-04fe0b3ba3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/0455dfca-9238-45a9-81aa-040be8160091_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/3a4cb515-52c8-42c6-8713-417f895335ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/c1570bb2-96e1-40c0-8888-2ee371e0928c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/a3cc2049-28a2-43cd-993e-49730283b134_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/8ecac017-507c-4a2b-b889-af01b5a9d68f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/19- 10K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 65K, 73K, 81K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74aec3d1-e7ee-4e7f-8d9f-1e3102041104.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117073655, 'registration': 'LR17FME', 'account': 'CAR001', 'make': 'MERCEDES-BENZ', 'model': 'E CLASS DIESEL SALOON', 'derivative': 'E220d AMG Line 4dr 9G-Tronic', 'mileage': 86916, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 4, 'engineSize': 1950, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LR17FME/2025-11-10/image/30231d22-18e1-4b78-9d49-c0add20dc67f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/2fb04e9f-a99e-4c08-967c-9ee854f5e4d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/81666646-91c1-4aac-8e08-ad65ea9c9484_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/301fec2f-6884-4dd8-bbf7-04fe0b3ba3ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/0455dfca-9238-45a9-81aa-040be8160091_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/3a4cb515-52c8-42c6-8713-417f895335ef_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/c1570bb2-96e1-40c0-8888-2ee371e0928c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/a3cc2049-28a2-43cd-993e-49730283b134_removebg.jpg?w=600', 'https://abimg003.imgix.net/LR17FME/2025-11-10/image/8ecac017-507c-4a2b-b889-af01b5a9d68f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 08/19- 10K', 'remarks': 'OUTSTANDING RECALL, VOSA STATES 55K, 65K, 73K, 81K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 112, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/74aec3d1-e7ee-4e7f-8d9f-1e3102041104.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 35d60169-d726-52bd-b98f-9f6199229852 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 35d60169-d726-52bd-b98f-9f6199229852 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 35d60169-d726-52bd-b98f-9f6199229852, identifier: 117073655
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117121221, 'registration': 'YP22XFK', 'account': 'THE142', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto', 'mileage': 17611, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-14', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22XFK/2025-11-13/image/362d1d7a-681a-409b-be40-cede1246b497_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/eee466dd-05e9-41cb-9b5a-9bdd5430f1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/916971f4-1ffd-483f-993c-78f680fd1378_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/abe7aa43-786c-4cc6-aa3a-026d55dda66c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/73453dfe-b546-4b06-ae99-797d5126eb19_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18aa6029-c39d-4c13-b389-8afcc10c3104_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18341d90-6072-48ca-993a-d491aec12c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/5008c607-30e4-477c-ac47-7ef11f594f00_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/2a9b0bac-056e-4d9d-b7aa-1375b5405bdc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/23-10K, 06/24-14K, 06/25-17K', 'remarks': 'STOLEN/RECOVERED - Damage is front end and minor dents/scratches VOSA STATES 17K', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0e0d0e3-cbb0-43f4-97b4-3b753e431cb8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117121221, 'registration': 'YP22XFK', 'account': 'THE142', 'make': 'SUZUKI', 'model': 'VITARA ESTATE', 'derivative': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto', 'mileage': 17611, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-07-14', 'fuel': 'Petrol', 'motExpiry': '2026-07-22', 'doors': 5, 'engineSize': 1373, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP22XFK/2025-11-13/image/362d1d7a-681a-409b-be40-cede1246b497_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/eee466dd-05e9-41cb-9b5a-9bdd5430f1d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/916971f4-1ffd-483f-993c-78f680fd1378_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/abe7aa43-786c-4cc6-aa3a-026d55dda66c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/73453dfe-b546-4b06-ae99-797d5126eb19_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18aa6029-c39d-4c13-b389-8afcc10c3104_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/18341d90-6072-48ca-993a-d491aec12c91_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/5008c607-30e4-477c-ac47-7ef11f594f00_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP22XFK/2025-11-13/image/2a9b0bac-056e-4d9d-b7aa-1375b5405bdc_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 06/23-10K, 06/24-14K, 06/25-17K', 'remarks': 'STOLEN/RECOVERED - Damage is front end and minor dents/scratches VOSA STATES 17K', 'virtual': False, 'seller': 'Auction Plus', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f0e0d0e3-cbb0-43f4-97b4-3b753e431cb8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0d07d2e4-2037-54bb-880e-739d9b317cff with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0d07d2e4-2037-54bb-880e-739d9b317cff with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0d07d2e4-2037-54bb-880e-739d9b317cff, identifier: 117121221
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117662789, 'registration': 'VK18HKV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE Business 5dr [Nav/Servotronic]', 'mileage': 95024, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/19- 17K, 03/21- 32K', 'remarks': 'OUTSTANDING RECALL VOSA STATES 41K, 53K, 72K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff5eb868-7ca2-41fa-91f7-d4f56b84af2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117662789, 'registration': 'VK18HKV', 'account': 'CAR001', 'make': 'BMW', 'model': '1 SERIES DIESEL HATCHBACK', 'derivative': '116d SE Business 5dr [Nav/Servotronic]', 'mileage': 95024, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-03-31', 'fuel': 'Diesel', 'motExpiry': '2026-07-18', 'doors': 5, 'engineSize': 1496, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/VK18HKV/2025-12-02/image/abc41b92-b014-4717-8dea-b02793df9c2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/17c20128-4619-465f-8a52-f33b39277578_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/30b3c443-9c0b-4174-8f7c-24cc9091b753_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/99ac4343-0099-439f-ae2c-751268e38d0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1e2ed9ad-e92a-4cd2-bf43-cfd151892995_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/548f717c-a2ea-4b05-886e-bd57d50e7da7_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1adb5a1e-d0cf-49aa-ac98-4f49d8f23139_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/1ca35411-ba88-46d5-9fb5-8d6de66fbc3d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/ce44da85-dc4b-40ea-8001-3626f9e02071_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/d9eaeff8-f4fa-4903-8de7-841427d7bf2c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/af60633e-d94e-467f-a62f-e5337a858e03_removebg.jpg?w=600', 'https://abimg003.imgix.net/VK18HKV/2025-12-02/image/79569779-0a7c-4cb3-999c-caa52afde85b_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 07/19- 17K, 03/21- 32K', 'remarks': 'OUTSTANDING RECALL VOSA STATES 41K, 53K, 72K, 90K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 114, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ff5eb868-7ca2-41fa-91f7-d4f56b84af2a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ad2289b-de47-5f0c-a95e-00230942d029 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ad2289b-de47-5f0c-a95e-00230942d029 with scrape type 2
2025-12-04 19:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4ad2289b-de47-5f0c-a95e-00230942d029, identifier: 117662789
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c6f410>
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FEK17AXM%252F2025-12-04%252Fimage%252Fa59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d8617e9d-0657-5655-8192-c831e1b9d866
2025-12-04 19:03:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d8617e9d-0657-5655-8192-c831e1b9d866, skipping ID generation
2025-12-04 19:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8617e9d-0657-5655-8192-c831e1b9d866 with scrape type 1
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Removing item d8617e9d-0657-5655-8192-c831e1b9d866 from tracking dictionaries
2025-12-04 19:03:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d8617e9d-0657-5655-8192-c831e1b9d866 sending to next pipeline
2025-12-04 19:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8617e9d-0657-5655-8192-c831e1b9d866, identifier: 117749600
2025-12-04 19:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 with identifier: 117023522
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 spider: astonbarclay.gb
2025-12-04 19:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 08637a26-6b6d-5217-8eb1-7c440a9fcc73 due to rule: high_mileage_for_country.json, error: 159057 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    159057
{'auction_title': '',
 'c_o_2_emission_value': 171,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '08637a26-6b6d-5217-8eb1-7c440a9fcc73',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS70PZX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117023522',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q5 DIESEL ESTATE',
 'odometer': 98834,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-04',
 'seller_name': 'Auction Plus',
 'title': 'AUDI Q5 DIESEL ESTATE 40 TDI Quattro S Line 5dr S Tronic',
 'transmission': 'automatic',
 'trim': '40 TDI Quattro S Line 5dr S Tronic',
 'vin': None,
 'year': 2020}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117023522%27 HTTP/1.1" 200 None
2025-12-04 19:03:39 [astonbarclay.gb] INFO: Saving data for 117023522: {'auction_closing_time': 1764936000.0, 'created_time': 1762844451.154343, 'last_price_update_time': 1764875019.26662}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117023522') HTTP/1.1" 204 0
2025-12-04 19:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 with identifier: 117480843
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 with identifier: 117480843
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 131349 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131349
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 spider: astonbarclay.gb
2025-12-04 19:03:39 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 8a1d0c14-856d-5f0b-85a0-980a2db8a0f3 due to rule: high_mileage_for_make.json, error: 131349 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    131349
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '8a1d0c14-856d-5f0b-85a0-980a2db8a0f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EN67GHH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117480843',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'RENAULT',
 'model': 'KADJAR DIESEL HATCHBACK',
 'odometer': 81617,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': 'Auction Plus',
 'title': 'RENAULT KADJAR DIESEL HATCHBACK 1.5 dCi Dynamique S Nav 5dr',
 'transmission': 'manual',
 'trim': '1.5 dCi Dynamique S Nav 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117480843%27 HTTP/1.1" 200 None
2025-12-04 19:03:39 [astonbarclay.gb] INFO: Saving data for 117480843: {'auction_closing_time': 1764936000.0, 'created_time': 1764320465.184814, 'last_price_update_time': 1764875019.493814}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117480843') HTTP/1.1" 204 0
2025-12-04 19:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655
2025-12-04 19:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 35d60169-d726-52bd-b98f-9f6199229852 with identifier: 117073655 to the API
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2735d60169-d726-52bd-b98f-9f6199229852%27 HTTP/1.1" 200 None
2025-12-04 19:03:39 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 35d60169-d726-52bd-b98f-9f6199229852: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:38 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117073655?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '1.9L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '35d60169-d726-52bd-b98f-9f6199229852',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LR17FME',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117073655',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'E CLASS DIESEL SALOON',
 'odometer': 86916,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-01',
 'seller_name': 'CarGiant',
 'title': 'MERCEDES-BENZ E CLASS DIESEL SALOON E220d AMG Line 4dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'E220d AMG Line 4dr 9G-Tronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117073655%27 HTTP/1.1" 200 None
2025-12-04 19:03:39 [astonbarclay.gb] INFO: Saving data for 117073655: {'auction_closing_time': 1764936000.0, 'created_time': 1762801242.760563, 'last_price_update_time': 1764875019.777363}
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117073655') HTTP/1.1" 204 0
2025-12-04 19:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-12-04 19:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221
2025-12-04 19:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0d07d2e4-2037-54bb-880e-739d9b317cff with identifier: 117121221 to the API
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%270d07d2e4-2037-54bb-880e-739d9b317cff%27 HTTP/1.1" 200 None
2025-12-04 19:03:40 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 0d07d2e4-2037-54bb-880e-739d9b317cff: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:39 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117121221?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0d07d2e4-2037-54bb-880e-739d9b317cff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP22XFK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117121221',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SUZUKI',
 'model': 'VITARA ESTATE',
 'odometer': 17611,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-07-14',
 'seller_name': 'Auction Plus',
 'title': 'SUZUKI VITARA ESTATE 1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.4 Boosterjet 48V Hybrid SZ-T 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121221%27 HTTP/1.1" 200 None
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Saving data for 117121221: {'auction_closing_time': 1764936000.0, 'created_time': 1762974198.800817, 'last_price_update_time': 1764875020.069612}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117121221') HTTP/1.1" 204 0
2025-12-04 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4ad2289b-de47-5f0c-a95e-00230942d029 with identifier: 117662789
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 152925 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152925
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 4ad2289b-de47-5f0c-a95e-00230942d029 spider: astonbarclay.gb
2025-12-04 19:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4ad2289b-de47-5f0c-a95e-00230942d029 due to rule: high_mileage_for_country.json, error: 152925 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    152925
{'auction_title': '',
 'c_o_2_emission_value': 114,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4ad2289b-de47-5f0c-a95e-00230942d029',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VK18HKV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662789',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES DIESEL HATCHBACK',
 'odometer': 95024,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-31',
 'seller_name': 'CarGiant',
 'title': 'BMW 1 SERIES DIESEL HATCHBACK 116d SE Business 5dr '
          '[Nav/Servotronic]',
 'transmission': 'manual',
 'trim': '116d SE Business 5dr [Nav/Servotronic]',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662789%27 HTTP/1.1" 200 None
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Saving data for 117662789: {'auction_closing_time': 1764936000.0, 'created_time': 1764702122.476574, 'last_price_update_time': 1764875020.285597}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662789') HTTP/1.1" 204 0
2025-12-04 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8617e9d-0657-5655-8192-c831e1b9d866 with identifier: 117749600
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8617e9d-0657-5655-8192-c831e1b9d866 with identifier: 117749600
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 168430 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168430
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d8617e9d-0657-5655-8192-c831e1b9d866 spider: astonbarclay.gb
2025-12-04 19:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d8617e9d-0657-5655-8192-c831e1b9d866 due to rule: high_mileage_for_country.json, error: 168430 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    168430
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-10T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': 'd8617e9d-0657-5655-8192-c831e1b9d866',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'EK17AXM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117749600',
 'listing': 'auction',
 'location': 'Aston Barclay Westbury',
 'make': 'HYUNDAI',
 'model': 'I20 HATCHBACK',
 'odometer': 104658,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24426,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/567090c6-f121-494a-903f-b82732077fc7_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24124,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/1672f457-3a03-4bcb-83e3-2ab064895fdc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23089,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/b9fc3efd-0377-4213-ae21-21ce026739a6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 23902,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/d4219412-a161-4625-9a37-c3990603d2a9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40133,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/664c68b5-a624-403b-ad65-def33b712824_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d8617e9d-0657-5655-8192-c831e1b9d866/d8617e9d-0657-5655-8192-c831e1b9d866_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98259,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/EK17AXM/2025-12-04/image/a59da8dc-bcdc-4c3c-90ea-10a029729217_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-27',
 'seller_name': 'Anchor Group Remarketing',
 'title': 'HYUNDAI I20 HATCHBACK 1.2 S Air 5dr',
 'transmission': 'manual',
 'trim': '1.2 S Air 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117749600%27 HTTP/1.1" 200 None
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Saving data for 117749600: {'created_time': 1764875020.559101, 'last_price_update_time': 1764875020.559111, 'auction_closing_time': 1765359900.0}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117749600') HTTP/1.1" 204 0
2025-12-04 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117662832?view=catalogue)
2025-12-04 19:03:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117452123?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117217399, 'registration': 'DU67AEP', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE 5dr Auto', 'mileage': 95720, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-08', 'fuel': 'Diesel', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67AEP/2025-11-14/image/d8d119d9-10c0-45f3-bbc7-a84d7f887756_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f46245b5-f5a9-465d-99eb-61d35f495693_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e82b037f-4da2-47f4-ae87-7f2cab5251f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f37ded18-4116-472a-b994-85c2f62593c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/87aa4fd2-4ba9-4ba6-a528-54f59028facb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/34dac5ec-fe12-40c3-af6a-314a84ac896d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f4b54e02-7021-42b5-b36e-48ddb2428c7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/fc6071ff-cb51-4138-a915-aad63aa1b399_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/27db63c6-21d7-43f2-bf34-b0210de5c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e6ec9931-3a09-43f9-a9aa-83c16a3da9ec_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice PRINT @ 10/18-14k - INVOICE @ 02/25-95k', 'remarks': 'VOSA STATES 46K 70K 91K 95K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40de7641-4eb0-4340-9a82-7ab711727724.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117217399, 'registration': 'DU67AEP', 'account': 'ZUT001', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE 5dr Auto', 'mileage': 95720, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2017-09-08', 'fuel': 'Diesel', 'motExpiry': '2026-09-13', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DU67AEP/2025-11-14/image/d8d119d9-10c0-45f3-bbc7-a84d7f887756_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f46245b5-f5a9-465d-99eb-61d35f495693_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e82b037f-4da2-47f4-ae87-7f2cab5251f6_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f37ded18-4116-472a-b994-85c2f62593c7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/87aa4fd2-4ba9-4ba6-a528-54f59028facb_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/34dac5ec-fe12-40c3-af6a-314a84ac896d_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/f4b54e02-7021-42b5-b36e-48ddb2428c7c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/fc6071ff-cb51-4138-a915-aad63aa1b399_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/27db63c6-21d7-43f2-bf34-b0210de5c445_removebg.jpg?w=600', 'https://abimg003.imgix.net/DU67AEP/2025-11-14/image/e6ec9931-3a09-43f9-a9aa-83c16a3da9ec_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice PRINT @ 10/18-14k - INVOICE @ 02/25-95k', 'remarks': 'VOSA STATES 46K 70K 91K 95K', 'virtual': False, 'seller': 'Zuto', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/40de7641-4eb0-4340-9a82-7ab711727724.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-04 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8318d99-8678-5a88-9fa1-07aa4df4b59c with scrape type 2
2025-12-04 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8318d99-8678-5a88-9fa1-07aa4df4b59c with scrape type 2
2025-12-04 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8318d99-8678-5a88-9fa1-07aa4df4b59c, identifier: 117217399
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117455255, 'registration': 'KE66HCZ', 'account': 'CAR001', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI S Line 5dr', 'mileage': 90697, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-08', 'fuel': 'Diesel', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/d89a467b-c3b6-454b-bec9-0589f5f49127_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/e82f0a04-6a1a-4b48-97ab-896f16a9d0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/edc54dfd-9a1b-4ad4-bfdb-6d1d019fcad0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/9d9596d0-f9cc-4574-a2e2-0e5d12c56e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/f09d1c9f-a7ca-473b-989c-5e36f7e11ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/4c24a39d-ffb0-44df-b63a-d6026fd7ee15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/1ea1ddde-c1a5-4ae4-b04e-5a3078ff0140_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/49df8654-13dc-4494-9cb1-74ccc1a53708_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/17- 15K, 11/18- 30K, 06/19- 40K', 'remarks': 'VOSA STATES 59K, 65K, 72K, 87K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/643db983-1531-4c1b-a57d-6b1133edcecb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:40 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117455255, 'registration': 'KE66HCZ', 'account': 'CAR001', 'make': 'AUDI', 'model': 'A3 DIESEL SPORTBACK', 'derivative': '1.6 TDI S Line 5dr', 'mileage': 90697, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-02-08', 'fuel': 'Diesel', 'motExpiry': '2026-08-19', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/d89a467b-c3b6-454b-bec9-0589f5f49127_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/e82f0a04-6a1a-4b48-97ab-896f16a9d0e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/edc54dfd-9a1b-4ad4-bfdb-6d1d019fcad0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/9d9596d0-f9cc-4574-a2e2-0e5d12c56e50_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/f09d1c9f-a7ca-473b-989c-5e36f7e11ec2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/4c24a39d-ffb0-44df-b63a-d6026fd7ee15_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/1ea1ddde-c1a5-4ae4-b04e-5a3078ff0140_removebg.jpg?w=600', 'https://abimg003.imgix.net/KE66HCZ/2025-11-24/image/49df8654-13dc-4494-9cb1-74ccc1a53708_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 10/17- 15K, 11/18- 30K, 06/19- 40K', 'remarks': 'VOSA STATES 59K, 65K, 72K, 87K - SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 108, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/643db983-1531-4c1b-a57d-6b1133edcecb.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-04 19:03:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f01bae-22c1-5991-936a-e03020abe19d with scrape type 2
2025-12-04 19:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f01bae-22c1-5991-936a-e03020abe19d with scrape type 2
2025-12-04 19:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 88f01bae-22c1-5991-936a-e03020abe19d, identifier: 117455255
2025-12-04 19:03:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8318d99-8678-5a88-9fa1-07aa4df4b59c with identifier: 117217399
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 154046 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154046
2025-12-04 19:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d8318d99-8678-5a88-9fa1-07aa4df4b59c spider: astonbarclay.gb
2025-12-04 19:03:40 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d8318d99-8678-5a88-9fa1-07aa4df4b59c due to rule: high_mileage_for_country.json, error: 154046 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    154046
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8318d99-8678-5a88-9fa1-07aa4df4b59c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DU67AEP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117217399',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 95720,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-08',
 'seller_name': 'Zuto',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117217399%27 HTTP/1.1" 200 None
2025-12-04 19:03:41 [astonbarclay.gb] INFO: Saving data for 117217399: {'auction_closing_time': 1764936000.0, 'created_time': 1764097462.098402, 'last_price_update_time': 1764875021.000295}
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117217399') HTTP/1.1" 204 0
2025-12-04 19:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-04 19:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255
2025-12-04 19:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 88f01bae-22c1-5991-936a-e03020abe19d with identifier: 117455255 to the API
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117455255?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 108,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': '88f01bae-22c1-5991-936a-e03020abe19d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KE66HCZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117455255',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A3 DIESEL SPORTBACK',
 'odometer': 90697,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-08',
 'seller_name': 'CarGiant',
 'title': 'AUDI A3 DIESEL SPORTBACK 1.6 TDI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.6 TDI S Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117455255%27 HTTP/1.1" 200 None
2025-12-04 19:03:41 [astonbarclay.gb] INFO: Saving data for 117455255: {'auction_closing_time': 1764936000.0, 'created_time': 1764010957.205306, 'last_price_update_time': 1764875021.312852}
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117455255') HTTP/1.1" 204 0
2025-12-04 19:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e61ed0>
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6ce1310>
2025-12-04 19:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FPL66FPO%252F2025-12-03%252Fimage%252F271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a868bd6-ed54-55cd-a025-9e926c1ca822
2025-12-04 19:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a868bd6-ed54-55cd-a025-9e926c1ca822, skipping ID generation
2025-12-04 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a868bd6-ed54-55cd-a025-9e926c1ca822 with scrape type 1
2025-12-04 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 5a868bd6-ed54-55cd-a025-9e926c1ca822 from tracking dictionaries
2025-12-04 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a868bd6-ed54-55cd-a025-9e926c1ca822 sending to next pipeline
2025-12-04 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 5a868bd6-ed54-55cd-a025-9e926c1ca822, identifier: 117662832
2025-12-04 19:03:42 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:42 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117452123, 'registration': 'KT66JVG', 'account': 'KCS003', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '2.0 Cooper S 5dr Auto', 'mileage': 93324, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-28', 'fuel': 'Petrol', 'motExpiry': '2026-04-11', 'doors': 5, 'engineSize': 1998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KT66JVG/2025-11-24/image/165f1191-a254-4dae-b8f8-27bf001b2cfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/de93ae43-0f37-473d-8d2e-1d95243fc5a5_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/fa342ea5-162d-45e0-a4dc-82ba3a0a3f9a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/f5ce7fcd-8984-4aa0-88d1-e2d6197622a6_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/8ef774d9-0134-4fb4-8adc-47197580ca5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/91f83bbe-5605-4598-82c0-e6b120b877fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/652a257d-d21c-443c-84da-b5d951368b6b_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/ca539604-6f2a-4c61-afef-6d79aac34944_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/5bc8f600-a33a-4789-9112-a7c4f6738f66_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/9b1f0fd4-4f4e-425b-b66e-c355e36146f0_removebg.jpg?w=600', 'https://abimg003.imgix.net/KT66JVG/2025-11-24/image/3937eb23-267e-4439-b76a-908346275c68_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service print and book 11/18 12k - 12/19 25k - 11/20 33K', 'remarks': 'VOSA STATES 40K - 60K - 75K - 87K- SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/382399e9-e13f-490b-a3f9-7abe4fa442bd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-04 19:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-12-04 19:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with scrape type 2
2025-12-04 19:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b, identifier: 117452123
2025-12-04 19:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 5a868bd6-ed54-55cd-a025-9e926c1ca822 with identifier: 117662832
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 5a868bd6-ed54-55cd-a025-9e926c1ca822 with identifier: 117662832
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 171603 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171603
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 5a868bd6-ed54-55cd-a025-9e926c1ca822 spider: astonbarclay.gb
2025-12-04 19:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 5a868bd6-ed54-55cd-a025-9e926c1ca822 due to rule: high_mileage_for_country.json, error: 171603 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    171603
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'ORANGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '5a868bd6-ed54-55cd-a025-9e926c1ca822',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PL66FPO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662832',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '1 SERIES HATCHBACK',
 'odometer': 106630,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 11,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34902,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/930db03e-ed2c-477e-8e15-cda43440e966_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38915,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/271d7f7e-ba94-44f6-a276-71c78d703003_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40187,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/4463cfba-1c8e-4ec5-9e93-24810b9d69d6_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38795,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/690f3a31-03e1-437e-9a31-dd0fe9e1a00a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49083,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/7f9bdf13-b205-4192-b32e-6beb5bbe82cf_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48152,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/73bff1e6-6faf-4a0e-ad85-76dc0124066e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48976,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/fed62595-0fd2-4c57-9021-cd8b5319aa74_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50752,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/09374c26-7270-4628-9404-a4820ec628dc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46556,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/31b5e15a-08d3-4924-be64-edec0874ae26_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57019,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/2effa2a3-b3ee-45c1-8b79-01e53748549e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a868bd6-ed54-55cd-a025-9e926c1ca822/5a868bd6-ed54-55cd-a025-9e926c1ca822_image_10.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57052,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/PL66FPO/2025-12-03/image/e0bf4962-2726-4587-af13-b3219328eee1_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-07',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'BMW 1 SERIES HATCHBACK 118i [1.5] SE 5dr [Nav]',
 'transmission': 'manual',
 'trim': '118i [1.5] SE 5dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662832%27 HTTP/1.1" 200 None
2025-12-04 19:03:42 [astonbarclay.gb] INFO: Saving data for 117662832: {'created_time': 1764875022.465128, 'last_price_update_time': 1764875022.465137, 'auction_closing_time': 1765188000.0}
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662832') HTTP/1.1" 204 0
2025-12-04 19:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b with identifier: 117452123
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
2025-12-04 19:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b spider: astonbarclay.gb
2025-12-04 19:03:42 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 20ab3011-b9cc-544b-bd87-9a940ebbfe5b due to rule: high_mileage_for_country.json, error: 150190 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150190
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '20ab3011-b9cc-544b-bd87-9a940ebbfe5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KT66JVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117452123',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 93324,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-28',
 'seller_name': 'CarBuy Lltd',
 'title': 'MINI HATCHBACK 2.0 Cooper S 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 Cooper S 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117452123%27 HTTP/1.1" 200 None
2025-12-04 19:03:42 [astonbarclay.gb] INFO: Saving data for 117452123: {'auction_closing_time': 1764936000.0, 'created_time': 1764010879.85748, 'last_price_update_time': 1764875022.696284}
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117452123') HTTP/1.1" 204 0
2025-12-04 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599337?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117515973?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117184599?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5993250>
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117599337, 'registration': 'RX66SOJ', 'account': 'KCS003', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 51716, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8352d9b7-2b45-4d23-b6c3-1bd4d26731ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8344a187-3a83-42dc-b285-3d5186c22d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/bca99add-dd7b-45cf-8e63-bd0d13e0015b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/1809bace-d439-4323-8904-1770ab30b2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/f48ced47-1995-4b08-a636-7097f476d130_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/cf79ba65-6ee5-4015-9510-6968135bb542_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/b7a532ee-17b7-4d0f-915b-3e6734d08987_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/a09b80c8-9cf7-41f6-a096-42ba73b4c7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/415efb34-4418-4019-bdb9-396d14c77118_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/0aa456a7-5e0c-49d1-93d8-fcf2d2866349_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K, 47K, 48K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f378cfd-2def-414b-abe5-9ba9cf4b883b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117599337, 'registration': 'RX66SOJ', 'account': 'KCS003', 'make': 'BMW', 'model': '2 SERIES COUPE', 'derivative': '218i M Sport 2dr [Nav]', 'mileage': 51716, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-11-02', 'doors': 2, 'engineSize': 1499, 'bodyType': 'Coupe', 'images': ['https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8352d9b7-2b45-4d23-b6c3-1bd4d26731ba_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/8344a187-3a83-42dc-b285-3d5186c22d3c_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/bca99add-dd7b-45cf-8e63-bd0d13e0015b_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/1809bace-d439-4323-8904-1770ab30b2d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/f48ced47-1995-4b08-a636-7097f476d130_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/cf79ba65-6ee5-4015-9510-6968135bb542_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/b7a532ee-17b7-4d0f-915b-3e6734d08987_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/a09b80c8-9cf7-41f6-a096-42ba73b4c7d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/415efb34-4418-4019-bdb9-396d14c77118_removebg.jpg?w=600', 'https://abimg003.imgix.net/RX66SOJ/2025-11-28/image/0aa456a7-5e0c-49d1-93d8-fcf2d2866349_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES 45K, 47K, 48K, 51K, SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9f378cfd-2def-414b-abe5-9ba9cf4b883b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-04 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9667a21-4fe8-5103-b36e-16045ddcf314 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9667a21-4fe8-5103-b36e-16045ddcf314 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c9667a21-4fe8-5103-b36e-16045ddcf314, identifier: 117599337
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117515973, 'registration': 'GJ17XMO', 'account': 'CAR001', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI 125 S 5dr', 'mileage': 161017, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-06-12', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/57688e26-ad3c-480f-870b-194b2d8e1628_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/6421c72d-72c0-4a79-afda-2b2f40f76985_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/c03d717a-9504-4a18-b067-2b83f06dbe11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/1cdbac46-1137-41a0-b357-41848d6b6e44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/220b5c0c-3069-4104-a4da-1646e6a4c955_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/e1a6ea0b-db8e-4ba2-b485-ccc56743515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/5c408507-a1bd-4798-bde2-e7f8241f7465_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/d45be747-f309-4580-bd16-ae7bd095b01e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES, 105K, 127K, 145K, 158K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa47ca87-0bf6-441d-a793-d9f4711420be.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117515973, 'registration': 'GJ17XMO', 'account': 'CAR001', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.4 TSI 125 S 5dr', 'mileage': 161017, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-03-24', 'fuel': 'Petrol', 'motExpiry': '2026-06-12', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/57688e26-ad3c-480f-870b-194b2d8e1628_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/6421c72d-72c0-4a79-afda-2b2f40f76985_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/c03d717a-9504-4a18-b067-2b83f06dbe11_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/1cdbac46-1137-41a0-b357-41848d6b6e44_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/220b5c0c-3069-4104-a4da-1646e6a4c955_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/e1a6ea0b-db8e-4ba2-b485-ccc56743515b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/5c408507-a1bd-4798-bde2-e7f8241f7465_removebg.jpg?w=600', 'https://abimg003.imgix.net/GJ17XMO/2025-11-26/image/d45be747-f309-4580-bd16-ae7bd095b01e_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'VOSA STATES, 105K, 127K, 145K, 158K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 120, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/aa47ca87-0bf6-441d-a793-d9f4711420be.pdf', 'assuredType': 'AA Lite', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-04 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8040e1d-d9df-5738-a043-035b26f47b96 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8040e1d-d9df-5738-a043-035b26f47b96 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: a8040e1d-d9df-5738-a043-035b26f47b96, identifier: 117515973
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117184599, 'registration': 'WD69GKL', 'account': 'AST003', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT Line 5dr', 'mileage': 82494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD69GKL/2025-11-12/image/eee80703-e24d-4fcd-b3bf-40c0147c2dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9c99e571-a41d-4bdc-8e4d-8c4dce196322_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/3008d473-3f04-4971-86ea-66c50ff400d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/ecc1b364-9626-41ab-8be6-83d1e166d5a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/03c2bc6d-fac1-4dfb-9775-59b44d79d966_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9addb163-a014-4c89-bef0-44cf8052dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/f3d78068-61fb-4db5-8e98-d57dfbd1ecd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e40f5d9f-e380-4320-8b18-901f9dae7ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e67dd8db-061b-4a51-af53-1938ad7737a2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'Possible wet belt problem - Coolant Issues VOSA STATES - 39K, 55K, 72K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd18bc03-3232-469b-9171-4ab27752a720.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117184599, 'registration': 'WD69GKL', 'account': 'AST003', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 100 GT Line 5dr', 'mileage': 82494, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2020-01-31', 'fuel': 'Petrol', 'motExpiry': '2026-01-30', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WD69GKL/2025-11-12/image/eee80703-e24d-4fcd-b3bf-40c0147c2dd3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9c99e571-a41d-4bdc-8e4d-8c4dce196322_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/3008d473-3f04-4971-86ea-66c50ff400d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/ecc1b364-9626-41ab-8be6-83d1e166d5a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/03c2bc6d-fac1-4dfb-9775-59b44d79d966_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/9addb163-a014-4c89-bef0-44cf8052dda8_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/f3d78068-61fb-4db5-8e98-d57dfbd1ecd4_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e40f5d9f-e380-4320-8b18-901f9dae7ac3_removebg.jpg?w=600', 'https://abimg003.imgix.net/WD69GKL/2025-11-12/image/e67dd8db-061b-4a51-af53-1938ad7737a2_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'Possible wet belt problem - Coolant Issues VOSA STATES - 39K, 55K, 72K', 'virtual': False, 'seller': 'TCB Group - Value', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/bd18bc03-3232-469b-9171-4ab27752a720.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-12-04 19:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9bb77e-2152-528d-b01d-123e231142e3 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9bb77e-2152-528d-b01d-123e231142e3 with scrape type 2
2025-12-04 19:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1e9bb77e-2152-528d-b01d-123e231142e3, identifier: 117184599
2025-12-04 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-04 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337
2025-12-04 19:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c9667a21-4fe8-5103-b36e-16045ddcf314 with identifier: 117599337 to the API
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117599337?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c9667a21-4fe8-5103-b36e-16045ddcf314',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'RX66SOJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599337',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '2 SERIES COUPE',
 'odometer': 51716,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'CarBuy Lltd',
 'title': 'BMW 2 SERIES COUPE 218i M Sport 2dr [Nav]',
 'transmission': 'manual',
 'trim': '218i M Sport 2dr [Nav]',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599337%27 HTTP/1.1" 200 None
2025-12-04 19:03:43 [astonbarclay.gb] INFO: Saving data for 117599337: {'auction_closing_time': 1764936000.0, 'created_time': 1764356764.480806, 'last_price_update_time': 1764875023.80428}
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599337') HTTP/1.1" 204 0
2025-12-04 19:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-04 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: a8040e1d-d9df-5738-a043-035b26f47b96 with identifier: 117515973
2025-12-04 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 161017, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4 tsi 125 s 5dr', 'license_plate': 'gj17xmo', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'volkswagen golf hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 259131}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.4l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gj17xmo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf hatchback',
     'model': 'golf hatchback',
     'odometer': 161017,
     'odometer_in_km': 259131,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-24',
     'sanitized_make': 'volkswagen',
     'seller_name': 'cargiant',
     'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr',
     'transmission': 'manual',
     'trim': '1.4 tsi 125 s 5dr',
     'vin': None,
     'year': 2017}
2025-12-04 19:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE failed for item: a8040e1d-d9df-5738-a043-035b26f47b96 spider: astonbarclay.gb
2025-12-04 19:03:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: a8040e1d-d9df-5738-a043-035b26f47b96 due to rule: high_mileage.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'white', 'original_photo_count': 0, 'seller_name': 'cargiant', 'price_includes_vat': False, 'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr', 'price': 0, 'currency': 'gbp', 'make': 'volkswagen', 'model': 'golf hatchback', 'transmission': 'manual', 'engine': '1.4l', 'fuel_type': 'petrol', 'odometer': 161017, 'odometer_reading_unit': 'mi', 'registration_date': '2017-03-24', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973', 'expiration_date': '2025-12-05t12:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.4 tsi 125 s 5dr', 'license_plate': 'gj17xmo', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 120, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96', 'current_year_diff': 8, 'age_in_months': 104, 'make_model': 'volkswagen golf hatchback', 'sanitized_make': 'volkswagen', 'odometer_in_km': 259131}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 104,
     'auction_title': '',
     'c_o_2_emission_value': 120,
     'color': 'white',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.4l',
     'expiration_date': '2025-12-05t12:00:00z',
     'fuel_type': 'petrol',
     'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'gj17xmo',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'volkswagen',
     'make_model': 'volkswagen golf hatchback',
     'model': 'golf hatchback',
     'odometer': 161017,
     'odometer_in_km': 259131,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-03-24',
     'sanitized_make': 'volkswagen',
     'seller_name': 'cargiant',
     'title': 'volkswagen golf hatchback 1.4 tsi 125 s 5dr',
     'transmission': 'manual',
     'trim': '1.4 tsi 125 s 5dr',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'a8040e1d-d9df-5738-a043-035b26f47b96',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GJ17XMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117515973',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 161017,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-24',
 'seller_name': 'CarGiant',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.4 TSI 125 S 5dr',
 'transmission': 'manual',
 'trim': '1.4 TSI 125 S 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117515973%27 HTTP/1.1" 200 None
2025-12-04 19:03:44 [astonbarclay.gb] INFO: Saving data for 117515973: {'auction_closing_time': 1764936000.0, 'created_time': 1764184074.856442, 'last_price_update_time': 1764875024.029537}
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117515973') HTTP/1.1" 204 0
2025-12-04 19:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-12-04 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1e9bb77e-2152-528d-b01d-123e231142e3 with identifier: 117184599
2025-12-04 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 132760 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132760
2025-12-04 19:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1e9bb77e-2152-528d-b01d-123e231142e3 spider: astonbarclay.gb
2025-12-04 19:03:44 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1e9bb77e-2152-528d-b01d-123e231142e3 due to rule: high_mileage_for_make.json, error: 132760 is greater than the maximum of 130000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 130000, 'type': 'integer'}

On instance['odometer_in_km']:
    132760
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '1e9bb77e-2152-528d-b01d-123e231142e3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WD69GKL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117184599',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 82494,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-31',
 'seller_name': 'TCB Group - Value',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 100 GT Line 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 100 GT Line 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117184599%27 HTTP/1.1" 200 None
2025-12-04 19:03:44 [astonbarclay.gb] INFO: Saving data for 117184599: {'auction_closing_time': 1765215000.0, 'created_time': 1762974281.721414, 'last_price_update_time': 1764875024.242908}
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117184599') HTTP/1.1" 204 0
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117425377?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117498468?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bad010>
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117430085?view=catalogue)
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd812fdd0>
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd69556d0>
2025-12-04 19:03:44 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117425377, 'registration': 'WT18WFL', 'account': 'KCS003', 'make': 'MITSUBISHI', 'model': 'OUTLANDER DIESEL ESTATE', 'derivative': '2.2 DI-D 4 5dr', 'mileage': 113744, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2018-07-31', 'fuel': 'Diesel', 'motExpiry': '2026-06-19', 'doors': 5, 'engineSize': 2268, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WT18WFL/2025-11-24/image/49151907-3d7c-4695-a858-c7c0a4d4a9b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/d53692d0-6cd3-4424-8827-c0c3fc20f818_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/4e102daf-d505-4a87-bd01-5bda607d6178_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/b1f4d46b-592e-4f64-b51a-55968ee0af9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/e2df6981-5f36-4ecd-802d-3fa07b020c5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/3638aacb-10c7-4835-ba42-7b95e84d8c0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/8c18838c-480a-4d09-8f80-6880afa7654f_removebg.jpg?w=600', 'https://abimg003.imgix.net/WT18WFL/2025-11-24/image/979ab6d2-af97-4127-b8c3-caae4af88ed0_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 04/18 13K - 11/19 28K - 09/20 33K - 08/21 46K - 04/22 58K - 02/23 70K - 12/23 85K - 07/24 97K - 06/25 110K', 'remarks': 'VOSA STATES 62K- 79K - 97K - 110K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'CarBuy Lltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ba3d3176-b5c1-4edd-9a63-655c9ba278a7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-04 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec51caee-5658-548b-b162-28ba8f6303d3 with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ec51caee-5658-548b-b162-28ba8f6303d3, identifier: 117425377
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 117498468, 'registration': 'GM17XED', 'account': 'CAR001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 101160, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GM17XED/2025-11-26/image/e42f3f23-344a-47d2-bca8-b4921d836a1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/c628983e-183f-4a95-984e-063daa6dd39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/6044d930-93f5-44a4-a876-328ef33b9190_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/42bcd19b-bdea-4e78-a7b8-0729d2368ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/1271f48a-ccf3-47a1-9a49-0919b2d3a3fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/0812ca6c-17f0-4965-83d1-5d3b4eca6381_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/4af7f511-9722-4731-a627-7f663001110b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/b8c393b0-e9a7-408f-b9f2-98daeb689647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/99503677-4a14-4a18-9d61-d92eef58714e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/36bdd5cc-5efe-426f-8f51-78076b3044e1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18-15K 06/19-26K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 64K 76K 86K 96K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01a8a745-47d1-479c-a13f-d6c6e740a7b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 117498468, 'registration': 'GM17XED', 'account': 'CAR001', 'make': 'AUDI', 'model': 'Q2 ESTATE', 'derivative': '1.4 TFSI S Line 5dr', 'mileage': 101160, 'mileageWarranty': False, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2017-07-06', 'fuel': 'Petrol', 'motExpiry': '2026-07-08', 'doors': 5, 'engineSize': 1395, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/GM17XED/2025-11-26/image/e42f3f23-344a-47d2-bca8-b4921d836a1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/c628983e-183f-4a95-984e-063daa6dd39d_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/6044d930-93f5-44a4-a876-328ef33b9190_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/42bcd19b-bdea-4e78-a7b8-0729d2368ebd_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/1271f48a-ccf3-47a1-9a49-0919b2d3a3fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/0812ca6c-17f0-4965-83d1-5d3b4eca6381_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/4af7f511-9722-4731-a627-7f663001110b_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/b8c393b0-e9a7-408f-b9f2-98daeb689647_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/99503677-4a14-4a18-9d61-d92eef58714e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GM17XED/2025-11-26/image/36bdd5cc-5efe-426f-8f51-78076b3044e1_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/18-15K 06/19-26K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 64K 76K 86K 96K', 'virtual': False, 'seller': 'CarGiant', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/01a8a745-47d1-479c-a13f-d6c6e740a7b6.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-04 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6ffa2e0-3016-58b5-bb72-774983a004f0 with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6ffa2e0-3016-58b5-bb72-774983a004f0 with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b6ffa2e0-3016-58b5-bb72-774983a004f0, identifier: 117498468
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117688144, 'registration': 'YB66MGO', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '2.0 TSI GTI 5dr DSG [Nav]', 'mileage': 71526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-08', 'fuel': 'Petrol', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/84481a61-c1b8-474e-838b-2d0799961c6e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117688144, 'registration': 'YB66MGO', 'account': 'THE109', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '2.0 TSI GTI 5dr DSG [Nav]', 'mileage': 71526, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-08', 'fuel': 'Petrol', 'motExpiry': '2026-01-12', 'doors': 5, 'engineSize': 1984, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 145, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/84481a61-c1b8-474e-838b-2d0799961c6e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with identifier: 117688144
2025-12-04 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with scrape type 1
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Ff3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117702288, 'registration': 'CK66FHR', 'account': 'THE109', 'make': 'FORD', 'model': 'FOCUS HATCHBACK SPECIAL EDITIONS', 'derivative': '2.0 TDCi Zetec S Red 5dr', 'mileage': 67530, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c2018b33-63da-4660-929d-d9d57891a1ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117702288, 'registration': 'CK66FHR', 'account': 'THE109', 'make': 'FORD', 'model': 'FOCUS HATCHBACK SPECIAL EDITIONS', 'derivative': '2.0 TDCi Zetec S Red 5dr', 'mileage': 67530, 'mileageWarranty': True, 'type': 'car', 'saleId': 17991, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2016-09-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-12', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': False, 'v5details': None, 'co2': 105, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c2018b33-63da-4660-929d-d9d57891a1ae.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: beced978-4d68-5b8d-b104-a91d6c24e3c0 with identifier: 117702288
2025-12-04 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beced978-4d68-5b8d-b104-a91d6c24e3c0 with scrape type 1
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fb5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117632563, 'registration': 'WL19RLV', 'account': 'MAN037', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 42899, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-07-12', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 33K', 'remarks': 'VOSA STATES 18K - 27K - 36K- 42K (FAIL) - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a607f00c-bc41-4c01-9424-3a706f794c54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117632563, 'registration': 'WL19RLV', 'account': 'MAN037', 'make': 'MG MOTOR UK', 'model': 'MG3 HATCHBACK', 'derivative': '1.5 VTi-TECH Exclusive 5dr', 'mileage': 42899, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2019-06-29', 'fuel': 'Petrol', 'motExpiry': '2025-07-12', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WL19RLV/2025-12-01/image/eb9b8c35-4d6f-4147-ad12-5cabec422197_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/d2a24375-171e-4501-8a81-8a55efa8c542_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4d574f6b-6e0d-4c9c-b72c-426fe5c5e208_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/af3fc48b-79a9-46a1-a39f-3f4904e08f5d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/f0166b53-82f4-4b4b-aef1-7df1a130b02d_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/4bcfea0b-3877-4b2b-911d-d7813da4fcd9_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/61489502-b40d-4f40-95bf-8b4d75a802d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WL19RLV/2025-12-01/image/ca6a3055-4e9c-42b6-93e6-7a8bb1e6056e_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': 'Service book 12/20 33K', 'remarks': 'VOSA STATES 18K - 27K - 36K- 42K (FAIL) - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 140, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a607f00c-bc41-4c01-9424-3a706f794c54.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-04 19:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 315a462f-b1fb-5767-99b3-d3e45f95653b with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 315a462f-b1fb-5767-99b3-d3e45f95653b with scrape type 2
2025-12-04 19:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 315a462f-b1fb-5767-99b3-d3e45f95653b, identifier: 117632563
2025-12-04 19:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ec51caee-5658-548b-b162-28ba8f6303d3 with identifier: 117425377
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: ec51caee-5658-548b-b162-28ba8f6303d3 spider: astonbarclay.gb
2025-12-04 19:03:45 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: ec51caee-5658-548b-b162-28ba8f6303d3 due to rule: high_mileage_for_country.json, error: 183052 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    183052
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.3L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'ec51caee-5658-548b-b162-28ba8f6303d3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WT18WFL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117425377',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MITSUBISHI',
 'model': 'OUTLANDER DIESEL ESTATE',
 'odometer': 113744,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-31',
 'seller_name': 'CarBuy Lltd',
 'title': 'MITSUBISHI OUTLANDER DIESEL ESTATE 2.2 DI-D 4 5dr',
 'transmission': 'manual',
 'trim': '2.2 DI-D 4 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117425377%27 HTTP/1.1" 200 None
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Saving data for 117425377: {'auction_closing_time': 1764936000.0, 'created_time': 1763751630.089459, 'last_price_update_time': 1764875025.655655}
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117425377') HTTP/1.1" 204 0
2025-12-04 19:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b6ffa2e0-3016-58b5-bb72-774983a004f0 with identifier: 117498468
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162800 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162800
2025-12-04 19:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b6ffa2e0-3016-58b5-bb72-774983a004f0 spider: astonbarclay.gb
2025-12-04 19:03:45 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b6ffa2e0-3016-58b5-bb72-774983a004f0 due to rule: high_mileage_for_country.json, error: 162800 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162800
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b6ffa2e0-3016-58b5-bb72-774983a004f0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GM17XED',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117498468',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'Q2 ESTATE',
 'odometer': 101160,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-06',
 'seller_name': 'CarGiant',
 'title': 'AUDI Q2 ESTATE 1.4 TFSI S Line 5dr',
 'transmission': 'manual',
 'trim': '1.4 TFSI S Line 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117498468%27 HTTP/1.1" 200 None
2025-12-04 19:03:45 [astonbarclay.gb] INFO: Saving data for 117498468: {'auction_closing_time': 1764936000.0, 'created_time': 1764097431.839747, 'last_price_update_time': 1764875025.863525}
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117498468') HTTP/1.1" 204 0
2025-12-04 19:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:03:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=YELLOW HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563
2025-12-04 19:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 315a462f-b1fb-5767-99b3-d3e45f95653b with identifier: 117632563 to the API
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27315a462f-b1fb-5767-99b3-d3e45f95653b%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 315a462f-b1fb-5767-99b3-d3e45f95653b: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:45 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117632563?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 140,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '315a462f-b1fb-5767-99b3-d3e45f95653b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WL19RLV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117632563',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MG MOTOR UK',
 'model': 'MG3 HATCHBACK',
 'odometer': 42899,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-29',
 'seller_name': 'Manamanx Ltd',
 'title': 'MG MOTOR UK MG3 HATCHBACK 1.5 VTi-TECH Exclusive 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTi-TECH Exclusive 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117632563%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [astonbarclay.gb] INFO: Saving data for 117632563: {'auction_closing_time': 1765215000.0, 'created_time': 1764615802.843844, 'last_price_update_time': 1764875026.346453}
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117632563') HTTP/1.1" 204 0
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Fa38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd59fa110>
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FBL23UVO%252F2025-11-25%252Fimage%252F33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 19d63544-e049-5468-b6e5-fc2a89322e9b
2025-12-04 19:03:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 19d63544-e049-5468-b6e5-fc2a89322e9b, skipping ID generation
2025-12-04 19:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 19d63544-e049-5468-b6e5-fc2a89322e9b with scrape type 1
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 19d63544-e049-5468-b6e5-fc2a89322e9b from tracking dictionaries
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 19d63544-e049-5468-b6e5-fc2a89322e9b sending to next pipeline
2025-12-04 19:03:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 19d63544-e049-5468-b6e5-fc2a89322e9b, identifier: 117430085
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 19d63544-e049-5468-b6e5-fc2a89322e9b with identifier: 117430085
2025-12-04 19:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 19d63544-e049-5468-b6e5-fc2a89322e9b with identifier: 117430085
2025-12-04 19:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 19d63544-e049-5468-b6e5-fc2a89322e9b with identifier: 117430085 to the API
2025-12-04 19:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 29,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '19d63544-e049-5468-b6e5-fc2a89322e9b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'BL23UVO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117430085',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CUPRA',
 'model': 'LEON ESTATE',
 'odometer': 33324,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 24964,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/417a497b-8d2d-4af7-9946-ccdb51a0f7c5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28928,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/64772a46-50bd-4b71-93da-d8e1091ea280_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28255,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/33dd9dcd-f393-4bc4-8b21-e8fba179c570_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 29704,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/2f00eb49-d23d-45c5-aa04-d3323968d941_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41430,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/8e0e1913-1b0d-43c2-b7b8-f3b67c7ba595_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68804,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/99c7d33c-1135-4d65-9e51-ae6f8fedd28e_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48587,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/a48dab95-861b-4925-8e68-197d7f0fd4ef_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51130,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/ba455ada-0bb3-4a02-8bfe-125434e76289_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_19d63544-e049-5468-b6e5-fc2a89322e9b/19d63544-e049-5468-b6e5-fc2a89322e9b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/BL23UVO/2025-11-25/image/29db4e6f-ecd2-4c6f-99b4-55d6a59fc427_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-06-30',
 'seller_name': 'Zenith',
 'title': 'CUPRA LEON ESTATE 1.4 eHybrid VZ2 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.4 eHybrid VZ2 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117430085%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Saving data for 117430085: {'created_time': 1764875027.231964, 'last_price_update_time': 1764875027.231979, 'auction_closing_time': 1764927900.0}
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117430085') HTTP/1.1" 204 0
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117615634?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117386686?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117735489, 'registration': 'OU16CFN', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '2.0T FSI S Line 4dr S Tronic', 'mileage': 89378, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1296, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 4, 'engineSize': 1984, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 54K, 64K, 76K, 83K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6935bb15-4646-43ff-b078-7aeefac687c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117735489, 'registration': 'OU16CFN', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A4 SALOON', 'derivative': '2.0T FSI S Line 4dr S Tronic', 'mileage': 89378, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1296, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-03-04', 'fuel': 'Petrol', 'motExpiry': '2026-03-25', 'doors': 4, 'engineSize': 1984, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 54K, 64K, 76K, 83K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6935bb15-4646-43ff-b078-7aeefac687c7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a571678-c46c-5eef-ab52-84fba943364c with identifier: 117735489
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a571678-c46c-5eef-ab52-84fba943364c with scrape type 1
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fdf5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117763614, 'registration': 'LP16WNB', 'account': 'MAN037', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 44509, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-06-24', 'fuel': 'Diesel', 'motExpiry': '2023-12-18', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c0262d5-3e85-41b6-be98-aad8e662e241.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117763614, 'registration': 'LP16WNB', 'account': 'MAN037', 'make': 'LAND ROVER', 'model': 'DISCOVERY SPORT DIESEL SW', 'derivative': '2.0 TD4 180 HSE 5dr Auto', 'mileage': 44509, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2016-06-24', 'fuel': 'Diesel', 'motExpiry': '2023-12-18', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': False, 'v5details': None, 'co2': 139, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6c0262d5-3e85-41b6-be98-aad8e662e241.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 774e01ff-523b-5b81-8269-e04b52e05313 with identifier: 117763614
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 774e01ff-523b-5b81-8269-e04b52e05313 with scrape type 1
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117763847, 'registration': 'CK17YKG', 'account': 'MAN037', 'make': 'SSANGYONG', 'model': 'TIVOLI DIESEL HATCHBACK', 'derivative': '1.6 D EX 5dr', 'mileage': 70416, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e61d07e5-12d4-499e-bf14-de7f7863b837.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117763847, 'registration': 'CK17YKG', 'account': 'MAN037', 'make': 'SSANGYONG', 'model': 'TIVOLI DIESEL HATCHBACK', 'derivative': '1.6 D EX 5dr', 'mileage': 70416, 'mileageWarranty': False, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': None, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2017-04-28', 'fuel': 'Diesel', 'motExpiry': '2026-06-08', 'doors': 5, 'engineSize': 1597, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': '', 'virtual': False, 'seller': 'Manamanx Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': False, 'v5details': None, 'co2': 113, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e61d07e5-12d4-499e-bf14-de7f7863b837.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6730a946-7cb0-5a5d-ad61-d8b076b876eb with identifier: 117763847
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb with scrape type 1
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F9553e376-2298-4456-a297-08d31971fea0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Ff99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Fa43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117615786?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': 'INTERMITTEN EML  - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207188, 'registration': 'BU21HYC', 'account': 'AST002', 'make': 'JEEP', 'model': 'RENEGADE HATCHBACK SPECIAL EDITION', 'derivative': '1.0 T3 GSE Night Eagle II 5dr', 'mileage': 21876, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2021-03-17', 'fuel': 'Petrol', 'motExpiry': '2025-01-22', 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BU21HYC/2025-11-18/image/e5c75224-a802-435f-b578-43508d0d9506_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/f2246be3-a9a6-496e-8c3d-5276412848e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/868263ca-69d0-413f-b361-6faa173d1a1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9687693f-f640-455e-992b-fb7c63681dff_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9f51af8f-617f-4146-acd0-f946bc471cfe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/82262a13-56d8-432a-bc7f-d520bca1776b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/d8f211c2-7bc0-4e94-b841-5d3006565666_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/ac0761ea-9300-4a59-90e6-9cc6cc027e5e_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/9fafc760-c61d-413b-9f99-67501b31c105_removebg.jpg?w=600', 'https://abimg003.imgix.net/BU21HYC/2025-11-18/image/356e5c26-9467-4311-96b3-daa734bae976_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 03/22-5k,  02/23-11k,  01/24-18k', 'remarks': 'INTERMITTEN EML  - SPARE KEY', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 152, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a929741f-2f35-43d3-a9cb-28dda0f6780c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e3e9c6c-f246-5405-ac96-76e6a1737954 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 0e3e9c6c-f246-5405-ac96-76e6a1737954, identifier: 117207188
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117615634, 'registration': 'YY65XWS', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A6 AVANT SPECIAL EDITIONS', 'derivative': '2.0 TDI Ultra Black Edition 5dr', 'mileage': 100873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-04', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY65XWS/2025-12-01/image/0bbbfc35-9725-4d5c-a6c7-a452d023730e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/0aec45c0-a907-442b-8dd1-da904add4705_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5ade9959-735a-412a-8a32-9d53440f9a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/bf753c3c-e63f-4734-ab6e-5db88dc655c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/b48f9a5f-63fb-48b2-8eef-852c0ae05aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/c88239c2-7f12-4438-8ee5-931e69c082a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/c11971ba-dd95-4d61-a4b8-4f4fe3b386aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5d1ef4fd-fec7-439c-a0be-92d5e5543d40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5e03c451-766b-4ff5-8276-bc6af8a13f5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/23e609c2-2c31-41e6-be02-e888fd9ab77a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES - 84K, 88K, 91K, 97K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce3845ae-41c9-4f64-8b21-0ee39e3f420e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117615634, 'registration': 'YY65XWS', 'account': 'WBA003', 'make': 'AUDI', 'model': 'A6 AVANT SPECIAL EDITIONS', 'derivative': '2.0 TDI Ultra Black Edition 5dr', 'mileage': 100873, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1270, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2015-12-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-04', 'doors': 5, 'engineSize': 1968, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YY65XWS/2025-12-01/image/0bbbfc35-9725-4d5c-a6c7-a452d023730e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/0aec45c0-a907-442b-8dd1-da904add4705_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5ade9959-735a-412a-8a32-9d53440f9a6e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/bf753c3c-e63f-4734-ab6e-5db88dc655c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/b48f9a5f-63fb-48b2-8eef-852c0ae05aaf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/c88239c2-7f12-4438-8ee5-931e69c082a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/c11971ba-dd95-4d61-a4b8-4f4fe3b386aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5d1ef4fd-fec7-439c-a0be-92d5e5543d40_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/5e03c451-766b-4ff5-8276-bc6af8a13f5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YY65XWS/2025-12-01/image/23e609c2-2c31-41e6-be02-e888fd9ab77a_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'VOSA STATES - 84K, 88K, 91K, 97K', 'virtual': False, 'seller': 'UKCGR - Select', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 124, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ce3845ae-41c9-4f64-8b21-0ee39e3f420e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e with identifier: 117615634
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 824ec02e-1cf5-5a0c-988b-0121f0c5f26e with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 824ec02e-1cf5-5a0c-988b-0121f0c5f26e with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e, identifier: 117615634
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117583759, 'registration': 'LB66AVM', 'account': 'STE093', 'make': 'BMW', 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK', 'derivative': '335d xDrive M Sport 5dr Step Auto [Business Media]', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/20 16K - 01/21 21K - 01/22 25K - 01/23 32K', 'remarks': 'VOSA STATES, 26K, 31K, 37K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80173def-9dbf-4990-a44c-f0cbfe30af8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117583759, 'registration': 'LB66AVM', 'account': 'STE093', 'make': 'BMW', 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK', 'derivative': '335d xDrive M Sport 5dr Step Auto [Business Media]', 'mileage': 48944, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-11-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2993, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB66AVM/2025-12-01/image/b387e301-c92b-44ff-b393-3ede44830b6d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1ee2b024-5002-4147-a8a5-1a6d9addde23_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/059e3e4d-3359-4fb7-97b2-ec35a2823d89_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/ca952cdc-1ef5-4030-b8ee-8ad926443e33_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/c233feda-fb26-4c8f-9198-1b3402a634ca_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/1edf8ba4-345d-4c2c-a13c-c588b2af83ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/f917434e-1f34-4d80-9d4e-dc94bd53757e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/09dd2531-a177-4090-b146-39b989553254_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/3bad41e8-555c-4d01-9e08-c58d2065170f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB66AVM/2025-12-01/image/eb36ef3d-ad39-4952-9e2f-d2cd6c843415_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/20 16K - 01/21 21K - 01/22 25K - 01/23 32K', 'remarks': 'VOSA STATES, 26K, 31K, 37K, 44K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Hedin Automotive BMW', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/80173def-9dbf-4990-a44c-f0cbfe30af8f.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91e3816c-1299-58c7-b5f9-71f70184e072 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91e3816c-1299-58c7-b5f9-71f70184e072 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 91e3816c-1299-58c7-b5f9-71f70184e072, identifier: 117583759
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117386686, 'registration': 'FJ66HOA', 'account': 'MER167', 'make': 'BMW', 'model': 'X5', 'derivative': 'xDrive40d M Sport 5dr Auto [7 Seat]', 'mileage': 86952, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': 3000, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/7bd945ee-e9c3-4c26-92a6-13bf202b5926_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/650d96c4-a17c-4988-b032-8a7d41438d76_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/e2028812-2111-4b01-a0fe-0e718e74f841_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/217b4a82-7510-44b6-b519-24081dbe3552_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/f258a7f4-efc9-4ee5-a0ee-f7b6dd55d298_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/4fed055c-3a4b-431b-a2a3-e6bf9d840dc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/f704db9b-d4e4-4e69-adf5-37388292ac61_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/eb58285c-7a50-4f72-8312-089766c6beb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/03cfb99a-df5d-4322-8342-8c1ffe5b3013_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/d7ddaee4-4fe5-40d0-9104-45336aa922f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/c6dc938d-465e-4fe1-9ca4-e6efd666693a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/bf6c2ff6-6a36-469e-998a-d101b3042efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/0b6298df-35df-4391-aec0-b0d5cd0d3e8b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/15 8K - 12/15 18K - 01/16 26K - 10/17 43K - 15/12 41K', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and normal wear VOSA STATES, 50K, 60K, 75K, 85K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/45d1b58b-f538-471d-8534-de6856bc7998.pdf', 'assuredType': 'AA', 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117386686, 'registration': 'FJ66HOA', 'account': 'MER167', 'make': 'BMW', 'model': 'X5', 'derivative': 'xDrive40d M Sport 5dr Auto [7 Seat]', 'mileage': 86952, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-01', 'fuel': 'Diesel', 'motExpiry': '2026-08-06', 'doors': 5, 'engineSize': 3000, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/7bd945ee-e9c3-4c26-92a6-13bf202b5926_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/650d96c4-a17c-4988-b032-8a7d41438d76_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/e2028812-2111-4b01-a0fe-0e718e74f841_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/217b4a82-7510-44b6-b519-24081dbe3552_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/f258a7f4-efc9-4ee5-a0ee-f7b6dd55d298_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/4fed055c-3a4b-431b-a2a3-e6bf9d840dc1_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/f704db9b-d4e4-4e69-adf5-37388292ac61_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/eb58285c-7a50-4f72-8312-089766c6beb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/03cfb99a-df5d-4322-8342-8c1ffe5b3013_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/d7ddaee4-4fe5-40d0-9104-45336aa922f9_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/c6dc938d-465e-4fe1-9ca4-e6efd666693a_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/bf6c2ff6-6a36-469e-998a-d101b3042efa_removebg.jpg?w=600', 'https://abimg003.imgix.net/FJ66HOA/2025-12-02/image/0b6298df-35df-4391-aec0-b0d5cd0d3e8b_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 04/15 8K - 12/15 18K - 01/16 26K - 10/17 43K - 15/12 41K', 'remarks': 'USED UNRECORDED - Damage is minor dents/scratches and normal wear VOSA STATES, 50K, 60K, 75K, 85K', 'virtual': False, 'seller': 'Hedin Automotive', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 164, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/45d1b58b-f538-471d-8534-de6856bc7998.pdf', 'assuredType': 'AA', 'imported': True, 'eurostatus': None, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20199a2f-03b0-5331-8e5b-f59be60bd090 with identifier: 117386686
2025-12-04 19:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20199a2f-03b0-5331-8e5b-f59be60bd090 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20199a2f-03b0-5331-8e5b-f59be60bd090 with scrape type 2
2025-12-04 19:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 20199a2f-03b0-5331-8e5b-f59be60bd090, identifier: 117386686
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fa775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fb5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fc325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F100d1200-2671-45f0-be18-821b567aecea_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188
2025-12-04 19:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 0e3e9c6c-f246-5405-ac96-76e6a1737954 with identifier: 117207188 to the API
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207188?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 152,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '0e3e9c6c-f246-5405-ac96-76e6a1737954',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BU21HYC',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207188',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'JEEP',
 'model': 'RENEGADE HATCHBACK SPECIAL EDITION',
 'odometer': 21876,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': 'TCB Group - Prime',
 'title': 'JEEP RENEGADE HATCHBACK SPECIAL EDITION 1.0 T3 GSE Night Eagle II '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 T3 GSE Night Eagle II 5dr',
 'vin': None,
 'year': 2021}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207188%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [astonbarclay.gb] INFO: Saving data for 117207188: {'auction_closing_time': 1765188000.0, 'created_time': 1763492568.692688, 'last_price_update_time': 1764875028.344427}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207188') HTTP/1.1" 204 0
2025-12-04 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e with identifier: 117615634
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e with identifier: 117615634
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 162338 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162338
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e spider: astonbarclay.gb
2025-12-04 19:03:48 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 824ec02e-1cf5-5a0c-988b-0121f0c5f26e due to rule: high_mileage_for_country.json, error: 162338 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    162338
{'auction_title': '',
 'c_o_2_emission_value': 124,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '824ec02e-1cf5-5a0c-988b-0121f0c5f26e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YY65XWS',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117615634',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A6 AVANT SPECIAL EDITIONS',
 'odometer': 100873,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-11',
 'seller_name': 'UKCGR - Select',
 'title': 'AUDI A6 AVANT SPECIAL EDITIONS 2.0 TDI Ultra Black Edition 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDI Ultra Black Edition 5dr',
 'vin': None,
 'year': 2015}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615634%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [astonbarclay.gb] INFO: Saving data for 117615634: {'auction_closing_time': 1765215000.0, 'created_time': 1764442887.774943, 'last_price_update_time': 1764875028.578075}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117615634') HTTP/1.1" 204 0
2025-12-04 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759
2025-12-04 19:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 91e3816c-1299-58c7-b5f9-71f70184e072 with identifier: 117583759 to the API
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117583759?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '3.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '91e3816c-1299-58c7-b5f9-71f70184e072',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LB66AVM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117583759',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '3 SERIES GRAN TURISMO DIESEL HATCHBACK',
 'odometer': 48944,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': 'Hedin Automotive BMW',
 'title': 'BMW 3 SERIES GRAN TURISMO DIESEL HATCHBACK 335d xDrive M Sport 5dr '
          'Step Auto [Business Media]',
 'transmission': 'automatic',
 'trim': '335d xDrive M Sport 5dr Step Auto [Business Media]',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117583759%27 HTTP/1.1" 200 None
2025-12-04 19:03:48 [astonbarclay.gb] INFO: Saving data for 117583759: {'auction_closing_time': 1765188000.0, 'created_time': 1764615793.879856, 'last_price_update_time': 1764875028.973776}
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117583759') HTTP/1.1" 204 0
2025-12-04 19:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 20199a2f-03b0-5331-8e5b-f59be60bd090 with identifier: 117386686
2025-12-04 19:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 20199a2f-03b0-5331-8e5b-f59be60bd090 with identifier: 117386686
2025-12-04 19:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 20199a2f-03b0-5331-8e5b-f59be60bd090 with identifier: 117386686 to the API
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117386686?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': None,
 'engine': '3.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '20199a2f-03b0-5331-8e5b-f59be60bd090',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FJ66HOA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117386686',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 86952,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-01',
 'seller_name': 'Hedin Automotive',
 'title': 'BMW X5 xDrive40d M Sport 5dr Auto [7 Seat]',
 'transmission': 'automatic',
 'trim': 'xDrive40d M Sport 5dr Auto [7 Seat]',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117386686%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [astonbarclay.gb] INFO: Saving data for 117386686: {'auction_closing_time': 1765188000.0, 'created_time': 1764320489.959746, 'last_price_update_time': 1764875029.288742}
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117386686') HTTP/1.1" 204 0
2025-12-04 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5bd6050>
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fb5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fbeedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fd03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116988307?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117451336?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fe373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:49 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117615786, 'registration': 'SW66XBT', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 49408, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1260, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-11-23', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SW66XBT/2025-12-01/image/17a09007-b512-452c-9487-53820775d595_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/cc997b07-ed19-48ad-9769-7ee6dcf61799_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/6a2e5ce0-c849-41d2-8b6c-02d78dd6f7b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/253fdf5a-96ed-42d8-be90-baf812f04834_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/1564526d-7d04-416f-a0ee-a7b0dd1dec71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/2d6cf6d2-25ef-4e69-aeda-780e9237f58b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/8652fb22-538d-446b-badf-baf9f7ac1700_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/ecfc73d6-35ad-4d21-b4f3-7143e57c8601_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/67ac3de9-17f6-47df-abe4-3c811f6ff2f8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair VOSA STATES - 33K, 38K, 42K, 46K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7414d5cb-db1f-4ed2-93ff-d3c44b2ed6f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:49 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117615786, 'registration': 'SW66XBT', 'account': 'WBA002', 'make': 'FORD', 'model': 'ECOSPORT HATCHBACK', 'derivative': '1.0 EcoBoost Titanium 5dr', 'mileage': 49408, 'mileageWarranty': True, 'type': 'car', 'saleId': 17992, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T17:30Z', 'lot': 1260, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2016-11-23', 'fuel': 'Petrol', 'motExpiry': '2026-02-07', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SW66XBT/2025-12-01/image/17a09007-b512-452c-9487-53820775d595_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/cc997b07-ed19-48ad-9769-7ee6dcf61799_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/6a2e5ce0-c849-41d2-8b6c-02d78dd6f7b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/253fdf5a-96ed-42d8-be90-baf812f04834_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/1564526d-7d04-416f-a0ee-a7b0dd1dec71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/2d6cf6d2-25ef-4e69-aeda-780e9237f58b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/8652fb22-538d-446b-badf-baf9f7ac1700_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/ecfc73d6-35ad-4d21-b4f3-7143e57c8601_removebg.jpg?w=600', 'https://abimg003.imgix.net/SW66XBT/2025-12-01/image/67ac3de9-17f6-47df-abe4-3c811f6ff2f8_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': 'Cat N Insurance Loss', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'Category N Insurance Loss. No Structural Damage and Repairable - Insurer Decided Not to Repair VOSA STATES - 33K, 38K, 42K, 46K', 'virtual': False, 'seller': 'UKCGR - Premium', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '4', 'v5': True, 'v5details': 'Here', 'co2': 125, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7414d5cb-db1f-4ed2-93ff-d3c44b2ed6f0.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 5, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 442003d5-03c3-509f-8678-3fc8d0859115 with identifier: 117615786
2025-12-04 19:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 442003d5-03c3-509f-8678-3fc8d0859115 with scrape type 2
2025-12-04 19:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 442003d5-03c3-509f-8678-3fc8d0859115 with scrape type 2
2025-12-04 19:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 442003d5-03c3-509f-8678-3fc8d0859115, identifier: 117615786
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48dc810>
2025-12-04 19:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f42490>
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e5ef90>
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c6e9d0>
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fdf5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c67910>
2025-12-04 19:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd481fb90>
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e63250>
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 442003d5-03c3-509f-8678-3fc8d0859115 with identifier: 117615786
2025-12-04 19:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 442003d5-03c3-509f-8678-3fc8d0859115 with identifier: 117615786
2025-12-04 19:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 442003d5-03c3-509f-8678-3fc8d0859115 with identifier: 117615786 to the API
2025-12-04 19:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27442003d5-03c3-509f-8678-3fc8d0859115%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 442003d5-03c3-509f-8678-3fc8d0859115: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:03:51 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117615786?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 125,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '442003d5-03c3-509f-8678-3fc8d0859115',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SW66XBT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117615786',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'ECOSPORT HATCHBACK',
 'odometer': 49408,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-23',
 'seller_name': 'UKCGR - Premium',
 'title': 'FORD ECOSPORT HATCHBACK 1.0 EcoBoost Titanium 5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Titanium 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117615786%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Saving data for 117615786: {'auction_closing_time': 1765215000.0, 'created_time': 1764442888.074064, 'last_price_update_time': 1764875032.166786}
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117615786') HTTP/1.1" 204 0
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fe30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117231043?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407202?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117272138?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116988307, 'registration': 'WM21ZBZ', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250e AMG Line 5dr Auto', 'mileage': 108793, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2044, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/ce2b509d-5846-43c0-8b01-002a5dda3ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/fba4b962-9168-4cbf-bc14-ace162419526_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/0647bb13-0cc2-4e5f-912a-e8c6805a4602_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/382a32de-a59d-4ae6-8ad3-77c68819b761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/ca009431-150c-4931-be11-5eceb6e55738_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/03b573d3-5424-4054-aad4-2703aa2bd1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/68e1fda0-f268-4c4a-9066-39832b0e9d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/0b724d3e-789f-4d8a-83c4-a7ad2983461e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/edf00723-e365-4a85-92b0-daf542dde03d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print SERVICES RECORDED IN MILES AND KM -01/23 32K - 05/24 82KM', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 82K, 106K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16455155-bc8c-403f-a6d6-c232f1ab78ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116988307, 'registration': 'WM21ZBZ', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'A CLASS HATCHBACK', 'derivative': 'A250e AMG Line 5dr Auto', 'mileage': 108793, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2044, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-06-30', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-28', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/ce2b509d-5846-43c0-8b01-002a5dda3ee7_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/fba4b962-9168-4cbf-bc14-ace162419526_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/0647bb13-0cc2-4e5f-912a-e8c6805a4602_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/382a32de-a59d-4ae6-8ad3-77c68819b761_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/ca009431-150c-4931-be11-5eceb6e55738_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/03b573d3-5424-4054-aad4-2703aa2bd1d6_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/68e1fda0-f268-4c4a-9066-39832b0e9d32_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/0b724d3e-789f-4d8a-83c4-a7ad2983461e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WM21ZBZ/2025-12-03/image/edf00723-e365-4a85-92b0-daf542dde03d_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print SERVICES RECORDED IN MILES AND KM -01/23 32K - 05/24 82KM', 'remarks': 'OUTSTANDING RECALL - VOSA STATES, 82K, 106K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 24, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/16455155-bc8c-403f-a6d6-c232f1ab78ca.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-12-04 19:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41bf6ac4-f348-5706-8fe9-40b48433019d with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41bf6ac4-f348-5706-8fe9-40b48433019d with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 41bf6ac4-f348-5706-8fe9-40b48433019d, identifier: 116988307
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117207172, 'registration': 'LP68KPL', 'account': 'AST002', 'make': 'HONDA', 'model': 'CR-V ESTATE', 'derivative': '1.5 VTEC Turbo SR 5dr', 'mileage': 66046, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': None, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-01-21', 'fuel': 'Petrol', 'motExpiry': '2026-02-16', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LP68KPL/2025-11-18/image/818c0937-a52a-4ead-b74f-7a340b4c9b4f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b3ecac5c-d76a-4609-ad45-6a9b745ed809_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/7993ee14-3934-4d82-a5cc-2b1a8ab270c5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/478e66a8-0389-4321-8355-d9461ba23778_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/4427cadb-798b-45b7-ac11-0f8fe0780deb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/5771ba0e-d625-40e5-9f30-a3233047e8ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/245f69b9-724d-4eca-9e94-b9628cef4a88_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/9ec46779-9821-4bca-99df-29192a601705_removebg.jpg?w=600', 'https://abimg003.imgix.net/LP68KPL/2025-11-18/image/b9ba36ce-e586-4a49-82d2-e9ceb5e08cf1_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**Intermittent EML - CHECK ASSURED REPORT - MAY HAVE FURTHER FAULTS - COLLECTION ONLY - NO DELIVERY AVAILABLE - VEHICLE LOCATED IN CHELMSFORD, ESSEX** - VOSA STATES, 40K, 48K, 55K, 63K - SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 151, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/a5d6c9cb-3550-4ac2-b87a-9dd71fc34512.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-04 19:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92454ddf-1dc2-588e-b630-dd71f18ddd7a with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 92454ddf-1dc2-588e-b630-dd71f18ddd7a, identifier: 117207172
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117451336, 'registration': 'LF72VMY', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 86749, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2045, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-06', 'fuel': 'Electric', 'motExpiry': '2026-10-26', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LF72VMY/2025-11-25/image/7a398b2c-502e-49e2-a6fd-c3a8633e8138_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/d317422d-fa34-46b3-96b1-84fdf292d639_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/02c4f375-b5d8-44be-bd70-367581dbb84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/5fc5b54f-8cea-43c5-9478-2b1e6bdad546_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/df7b27e2-ee1b-44f4-9dcc-f0a83eac7c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/4582d2fd-a808-4dc1-8eda-2d73562697f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/b5876f8a-20b9-4127-bd01-32797e890989_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/6760b944-6134-4a77-857a-0381893d4e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/d8eb4496-12b0-4177-a867-bf820061ccc3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - NO V5 FORMER KEEPERS UNKNOWN  - VOSA STATES 41K, 64K, 78K, 86K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/375c5e87-11d7-40f3-8aea-587aaaec10c1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117451336, 'registration': 'LF72VMY', 'account': 'MAN027', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'RWD 4dr Auto', 'mileage': 86749, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2045, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2022-12-06', 'fuel': 'Electric', 'motExpiry': '2026-10-26', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/LF72VMY/2025-11-25/image/7a398b2c-502e-49e2-a6fd-c3a8633e8138_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/d317422d-fa34-46b3-96b1-84fdf292d639_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/02c4f375-b5d8-44be-bd70-367581dbb84b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/5fc5b54f-8cea-43c5-9478-2b1e6bdad546_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/df7b27e2-ee1b-44f4-9dcc-f0a83eac7c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/4582d2fd-a808-4dc1-8eda-2d73562697f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/b5876f8a-20b9-4127-bd01-32797e890989_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/6760b944-6134-4a77-857a-0381893d4e0b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LF72VMY/2025-11-25/image/d8eb4496-12b0-4177-a867-bf820061ccc3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': 'Ex-Private Hire - NO V5 FORMER KEEPERS UNKNOWN  - VOSA STATES 41K, 64K, 78K, 86K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/375c5e87-11d7-40f3-8aea-587aaaec10c1.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a679df7-cea7-5937-a34f-d478506fbbc6 with identifier: 117451336
2025-12-04 19:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a679df7-cea7-5937-a34f-d478506fbbc6 with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a679df7-cea7-5937-a34f-d478506fbbc6 with scrape type 2
2025-12-04 19:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 1a679df7-cea7-5937-a34f-d478506fbbc6, identifier: 117451336
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Ffd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-12-04 19:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 41bf6ac4-f348-5706-8fe9-40b48433019d with identifier: 116988307
2025-12-04 19:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 175084 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175084
2025-12-04 19:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: 41bf6ac4-f348-5706-8fe9-40b48433019d spider: astonbarclay.gb
2025-12-04 19:03:52 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 41bf6ac4-f348-5706-8fe9-40b48433019d due to rule: high_mileage_for_country.json, error: 175084 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    175084
{'auction_title': '',
 'c_o_2_emission_value': 24,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '41bf6ac4-f348-5706-8fe9-40b48433019d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WM21ZBZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116988307',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'A CLASS HATCHBACK',
 'odometer': 108793,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-30',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ A CLASS HATCHBACK A250e AMG Line 5dr Auto',
 'transmission': 'automatic',
 'trim': 'A250e AMG Line 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116988307%27 HTTP/1.1" 200 None
2025-12-04 19:03:52 [astonbarclay.gb] INFO: Saving data for 116988307: {'auction_closing_time': 1765188000.0, 'created_time': 1764270174.988097, 'last_price_update_time': 1764875032.825375}
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116988307') HTTP/1.1" 204 0
2025-12-04 19:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-04 19:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172
2025-12-04 19:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 92454ddf-1dc2-588e-b630-dd71f18ddd7a with identifier: 117207172 to the API
2025-12-04 19:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117207172?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 151,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '92454ddf-1dc2-588e-b630-dd71f18ddd7a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP68KPL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117207172',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HONDA',
 'model': 'CR-V ESTATE',
 'odometer': 66046,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-21',
 'seller_name': 'TCB Group - Prime',
 'title': 'HONDA CR-V ESTATE 1.5 VTEC Turbo SR 5dr',
 'transmission': 'manual',
 'trim': '1.5 VTEC Turbo SR 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117207172%27 HTTP/1.1" 200 None
2025-12-04 19:03:53 [astonbarclay.gb] INFO: Saving data for 117207172: {'auction_closing_time': 1765188000.0, 'created_time': 1763449278.224542, 'last_price_update_time': 1764875033.141618}
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117207172') HTTP/1.1" 204 0
2025-12-04 19:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 1a679df7-cea7-5937-a34f-d478506fbbc6 with identifier: 117451336
2025-12-04 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 1a679df7-cea7-5937-a34f-d478506fbbc6 with identifier: 117451336
2025-12-04 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 139608 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    139608
2025-12-04 19:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_MAKE failed for item: 1a679df7-cea7-5937-a34f-d478506fbbc6 spider: astonbarclay.gb
2025-12-04 19:03:53 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 1a679df7-cea7-5937-a34f-d478506fbbc6 due to rule: high_mileage_for_make.json, error: 139608 is greater than the maximum of 100000

Failed validating 'maximum' in schema['allOf'][4]['then']['properties']['odometer_in_km']:
    {'maximum': 100000, 'type': 'integer'}

On instance['odometer_in_km']:
    139608
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '1a679df7-cea7-5937-a34f-d478506fbbc6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LF72VMY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117451336',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 86749,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-06',
 'seller_name': 'Mann Island Finance',
 'title': 'TESLA MODEL 3 SALOON RWD 4dr Auto',
 'transmission': 'automatic',
 'trim': 'RWD 4dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117451336%27 HTTP/1.1" 200 None
2025-12-04 19:03:53 [astonbarclay.gb] INFO: Saving data for 117451336: {'auction_closing_time': 1765188000.0, 'created_time': 1764406975.658795, 'last_price_update_time': 1764875033.351601}
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117451336') HTTP/1.1" 204 0
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fb4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117599215?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd69c6d10>
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5c61710>
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd485ecd0>
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4855b10>
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_1.jpg HTTP/1.1" 201 0
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Ff99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e6dbd0>
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd492c2d0>
2025-12-04 19:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a34c50>
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Fa43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4b010>
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117015819, 'registration': 'YK68PMZ', 'account': 'MAN027', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 3 5dr', 'mileage': 85543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2041, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20-10K, 1/21-19K, 1/22-27K, 1/23-36K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 27K, 36K, 44K, 66K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ddfbd5c-d2d6-4968-a2e7-9bf4b27d2187.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117015819, 'registration': 'YK68PMZ', 'account': 'MAN027', 'make': 'KIA', 'model': 'STONIC ESTATE', 'derivative': '1.0T GDi 3 5dr', 'mileage': 85543, 'mileageWarranty': False, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2041, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2019-02-20', 'fuel': 'Petrol', 'motExpiry': '2026-01-24', 'doors': 5, 'engineSize': 998, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ac67bfd7-016e-4acb-8108-da735dab579e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/7834ac06-1435-4205-bbb4-87cf75daf4e3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/baac186d-fdac-47a9-be5c-181be041d91c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/d45458c2-361b-456c-bbe0-28bdbfdf285a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/f56caaae-4c3d-4c6e-9104-b0d4861f4990_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/22511f7c-c2b3-4406-857d-01e07b231836_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/ec5d14ad-836c-429b-bc30-26356eefa39a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/9fec0651-8dc2-48d1-8d08-e7e36be89139_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK68PMZ/2025-11-07/image/6cf291a0-3379-4233-9e32-e31df69b5f37_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 2/20-10K, 1/21-19K, 1/22-27K, 1/23-36K', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 27K, 36K, 44K, 66K SPARE KEY AND SD CARD IN OFFICE', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3ddfbd5c-d2d6-4968-a2e7-9bf4b27d2187.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-12-04 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2010898b-61b7-5b42-aa87-6829b4572f48 with scrape type 2
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2010898b-61b7-5b42-aa87-6829b4572f48 with scrape type 2
2025-12-04 19:03:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2010898b-61b7-5b42-aa87-6829b4572f48, identifier: 117015819
2025-12-04 19:03:55 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117231043, 'registration': 'AP19NWJ', 'account': 'MAN027', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 66479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2040, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-31', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e703f0e0-cadf-4eb9-90e2-380c9e1cb0c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e8577366-029f-45b9-8c96-65e2339c8b00_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/5b609140-1443-4696-8e11-06202be4edac_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e6879b02-da73-4ab8-889b-a3bcd9cbd363_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/6dcba7f8-402d-4507-b3c8-a85e1266346d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/adec7744-62b8-4318-9772-c3ee03014ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/9367c13a-4e03-495f-bf39-4e36c544789d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/fc783e34-98ba-4e0e-a2be-595d5e943f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/4a275701-190f-4cbb-9cb0-bf6797e41224_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/20677804-b4c0-4d7b-a51f-a59bd9a021f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/9bae1b11-b43f-4517-8872-be9873ebdf37_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/20-13k 07/21-27k 07/22-42k 04/25-62k', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 36K 45K 56K 60K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88f23e55-e747-4efa-a014-f3d61b09676c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:55 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117231043, 'registration': 'AP19NWJ', 'account': 'MAN027', 'make': 'BMW', 'model': '5 SERIES DIESEL SALOON', 'derivative': '520d M Sport 4dr Auto', 'mileage': 66479, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2040, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2019-03-31', 'fuel': 'Diesel', 'motExpiry': '2025-12-16', 'doors': 4, 'engineSize': 1995, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e703f0e0-cadf-4eb9-90e2-380c9e1cb0c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e8577366-029f-45b9-8c96-65e2339c8b00_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/5b609140-1443-4696-8e11-06202be4edac_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/e6879b02-da73-4ab8-889b-a3bcd9cbd363_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/6dcba7f8-402d-4507-b3c8-a85e1266346d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/adec7744-62b8-4318-9772-c3ee03014ff0_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/9367c13a-4e03-495f-bf39-4e36c544789d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/fc783e34-98ba-4e0e-a2be-595d5e943f22_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/4a275701-190f-4cbb-9cb0-bf6797e41224_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/20677804-b4c0-4d7b-a51f-a59bd9a021f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/AP19NWJ/2025-11-14/image/9bae1b11-b43f-4517-8872-be9873ebdf37_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital 07/20-13k 07/21-27k 07/22-42k 04/25-62k', 'remarks': 'SPARE KEY IN OFFICE, VOSA STATES 36K 45K 56K 60K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/88f23e55-e747-4efa-a014-f3d61b09676c.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb519477-42ad-5c55-9944-8a5bc23a4198 with identifier: 117231043
2025-12-04 19:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb519477-42ad-5c55-9944-8a5bc23a4198 with scrape type 2
2025-12-04 19:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb519477-42ad-5c55-9944-8a5bc23a4198 with scrape type 2
2025-12-04 19:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fb519477-42ad-5c55-9944-8a5bc23a4198, identifier: 117231043
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407202, 'registration': 'BP66WWR', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 83633, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2031, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BP66WWR/2025-11-21/image/47d7bebd-3651-4739-82b0-15fc48d6e9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/28657593-9110-44a4-b3c8-34441ab2656b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/1550f871-69f6-4b44-8c01-c6f49c84326b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/e8c0b973-8b7f-41ca-8b64-1060dc2236d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/0d00a3ab-6202-4769-9605-42121646f3f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/9c567836-52b2-4af3-ae85-40d62689456b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/3d25e046-2e7a-4a1f-ac3b-2223a23018c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/030642a8-9289-432d-b14f-e60ba5b68608_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/891f0533-f6ed-4956-97bd-2bf24a1ad990_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/20-38K 01/21-46K 01/22-52K 06/24-71K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 54K 66K 70K 76K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c2be416-b16c-4cf2-8cee-7934380dd55b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407202, 'registration': 'BP66WWR', 'account': 'MAN027', 'make': 'MERCEDES-BENZ', 'model': 'GLC DIESEL ESTATE', 'derivative': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic', 'mileage': 83633, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2031, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2016-12-30', 'fuel': 'Diesel', 'motExpiry': '2026-01-26', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/BP66WWR/2025-11-21/image/47d7bebd-3651-4739-82b0-15fc48d6e9a9_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/28657593-9110-44a4-b3c8-34441ab2656b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/1550f871-69f6-4b44-8c01-c6f49c84326b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/e8c0b973-8b7f-41ca-8b64-1060dc2236d2_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/0d00a3ab-6202-4769-9605-42121646f3f8_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/9c567836-52b2-4af3-ae85-40d62689456b_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/3d25e046-2e7a-4a1f-ac3b-2223a23018c3_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/030642a8-9289-432d-b14f-e60ba5b68608_removebg.jpg?w=600', 'https://abimg003.imgix.net/BP66WWR/2025-11-21/image/891f0533-f6ed-4956-97bd-2bf24a1ad990_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service invoice 02/20-38K 01/21-46K 01/22-52K 06/24-71K', 'remarks': 'SD CARD IN OFFICE, VOSA STATES 54K 66K 70K 76K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c2be416-b16c-4cf2-8cee-7934380dd55b.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with identifier: 117407202
2025-12-04 19:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with scrape type 2
2025-12-04 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with scrape type 2
2025-12-04 19:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9, identifier: 117407202
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117272138, 'registration': 'ML18OHY', 'account': 'MAN027', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi Flair 5dr ETG', 'mileage': 46904, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2032, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML18OHY/2025-11-18/image/b20e4823-ff6a-40de-8db7-84b860fa615f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/72866192-ad59-4162-baa9-3cbc077902fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/5d913b58-645e-4b4c-bfc0-8d4196b5875d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/33971a3a-21c3-4939-b3e5-8632898ef853_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/dfdeb40a-ab1a-401c-b05e-7896b0e146d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/a9eefc62-50fc-41c7-a386-484d5187c1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/9e8f7156-ca5c-4694-a053-0c59ff3044aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/e85a5551-cfd2-46cf-a193-560ec8b2f69b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/c3755f62-63ca-457f-84b5-ebc3aab07949_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/21 13K', 'remarks': 'VOSA STATES, 23K, 34K, 41K, 44K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa40dcf5-9a12-4b5c-be1b-6258e8e396a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117272138, 'registration': 'ML18OHY', 'account': 'MAN027', 'make': 'CITROEN', 'model': 'C1 HATCHBACK', 'derivative': '1.0 VTi Flair 5dr ETG', 'mileage': 46904, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2032, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2018-03-30', 'fuel': 'Petrol', 'motExpiry': '2026-06-01', 'doors': 5, 'engineSize': 998, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/ML18OHY/2025-11-18/image/b20e4823-ff6a-40de-8db7-84b860fa615f_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/72866192-ad59-4162-baa9-3cbc077902fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/5d913b58-645e-4b4c-bfc0-8d4196b5875d_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/33971a3a-21c3-4939-b3e5-8632898ef853_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/dfdeb40a-ab1a-401c-b05e-7896b0e146d7_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/a9eefc62-50fc-41c7-a386-484d5187c1d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/9e8f7156-ca5c-4694-a053-0c59ff3044aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/e85a5551-cfd2-46cf-a193-560ec8b2f69b_removebg.jpg?w=600', 'https://abimg003.imgix.net/ML18OHY/2025-11-18/image/c3755f62-63ca-457f-84b5-ebc3aab07949_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/21 13K', 'remarks': 'VOSA STATES, 23K, 34K, 41K, 44K', 'virtual': False, 'seller': 'Mann Island Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fa40dcf5-9a12-4b5c-be1b-6258e8e396a8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f239cb93-4997-5bb3-82c9-03dc131c4a5b with identifier: 117272138
2025-12-04 19:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f239cb93-4997-5bb3-82c9-03dc131c4a5b with scrape type 2
2025-12-04 19:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f239cb93-4997-5bb3-82c9-03dc131c4a5b with scrape type 2
2025-12-04 19:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f239cb93-4997-5bb3-82c9-03dc131c4a5b, identifier: 117272138
2025-12-04 19:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-12-04 19:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819
2025-12-04 19:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2010898b-61b7-5b42-aa87-6829b4572f48 with identifier: 117015819 to the API
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117015819?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': '2010898b-61b7-5b42-aa87-6829b4572f48',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK68PMZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117015819',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'KIA',
 'model': 'STONIC ESTATE',
 'odometer': 85543,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-20',
 'seller_name': 'Mann Island Finance',
 'title': 'KIA STONIC ESTATE 1.0T GDi 3 5dr',
 'transmission': 'manual',
 'trim': '1.0T GDi 3 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117015819%27 HTTP/1.1" 200 None
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Saving data for 117015819: {'auction_closing_time': 1765188000.0, 'created_time': 1764270365.226441, 'last_price_update_time': 1764875036.439117}
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117015819') HTTP/1.1" 204 0
2025-12-04 19:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fb519477-42ad-5c55-9944-8a5bc23a4198 with identifier: 117231043
2025-12-04 19:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fb519477-42ad-5c55-9944-8a5bc23a4198 with identifier: 117231043
2025-12-04 19:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fb519477-42ad-5c55-9944-8a5bc23a4198 with identifier: 117231043 to the API
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117231043?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fb519477-42ad-5c55-9944-8a5bc23a4198',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AP19NWJ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117231043',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'BMW',
 'model': '5 SERIES DIESEL SALOON',
 'odometer': 66479,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-31',
 'seller_name': 'Mann Island Finance',
 'title': 'BMW 5 SERIES DIESEL SALOON 520d M Sport 4dr Auto',
 'transmission': 'automatic',
 'trim': '520d M Sport 4dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117231043%27 HTTP/1.1" 200 None
2025-12-04 19:03:56 [astonbarclay.gb] INFO: Saving data for 117231043: {'auction_closing_time': 1765188000.0, 'created_time': 1764442892.660096, 'last_price_update_time': 1764875036.721262}
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117231043') HTTP/1.1" 204 0
2025-12-04 19:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with identifier: 117407202
2025-12-04 19:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with identifier: 117407202
2025-12-04 19:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9 with identifier: 117407202 to the API
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117407202?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Diesel',
 'id': '7a10b70d-8b9b-589f-b24b-dfa93b6ea0f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BP66WWR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407202',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'MERCEDES-BENZ',
 'model': 'GLC DIESEL ESTATE',
 'odometer': 83633,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-30',
 'seller_name': 'Mann Island Finance',
 'title': 'MERCEDES-BENZ GLC DIESEL ESTATE GLC 220d 4Matic AMG Line Premium '
          '5dr 9G-Tronic',
 'transmission': 'automatic',
 'trim': 'GLC 220d 4Matic AMG Line Premium 5dr 9G-Tronic',
 'vin': None,
 'year': 2016}
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407202%27 HTTP/1.1" 200 None
2025-12-04 19:03:57 [astonbarclay.gb] INFO: Saving data for 117407202: {'auction_closing_time': 1765188000.0, 'created_time': 1764406979.488919, 'last_price_update_time': 1764875037.032929}
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407202') HTTP/1.1" 204 0
2025-12-04 19:03:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f239cb93-4997-5bb3-82c9-03dc131c4a5b with identifier: 117272138
2025-12-04 19:03:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f239cb93-4997-5bb3-82c9-03dc131c4a5b with identifier: 117272138
2025-12-04 19:03:57 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f239cb93-4997-5bb3-82c9-03dc131c4a5b with identifier: 117272138 to the API
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:03:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117272138?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f239cb93-4997-5bb3-82c9-03dc131c4a5b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'ML18OHY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117272138',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'CITROEN',
 'model': 'C1 HATCHBACK',
 'odometer': 46904,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-30',
 'seller_name': 'Mann Island Finance',
 'title': 'CITROEN C1 HATCHBACK 1.0 VTi Flair 5dr ETG',
 'transmission': 'automatic',
 'trim': '1.0 VTi Flair 5dr ETG',
 'vin': None,
 'year': 2018}
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117272138%27 HTTP/1.1" 200 None
2025-12-04 19:03:57 [astonbarclay.gb] INFO: Saving data for 117272138: {'auction_closing_time': 1765188000.0, 'created_time': 1764407017.160883, 'last_price_update_time': 1764875037.33245}
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117272138') HTTP/1.1" 204 0
2025-12-04 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:03:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b32d90>
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fbeedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd48bead0>
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fd03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd480e850>
2025-12-04 19:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg HTTP/1.1" 201 0
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b31110>
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4951a50>
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6b211d0>
2025-12-04 19:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd489b4d0>
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:03:59 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117599215, 'registration': 'CE71JYW', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 65315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2030, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-09-08', 'fuel': 'Electric', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CE71JYW/2025-12-01/image/92d33d41-fa34-4fcf-b64f-2f4e7914024c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/45a64c37-13fc-4158-b528-07e004d01b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/a14b3027-4e6b-4ec6-9989-4379326e7a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/9f1d621d-feec-48cc-a636-bf683be6864a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/94aa9176-a943-476f-a28e-fa2d3e70e81e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/6a394878-0fcc-4d3b-8d75-281e973afd63_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/75fdded3-9503-4a72-8d3e-a1a7a13fa851_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/1771e36b-af31-40f1-9faa-dc5e38b3888f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/91c58612-fda5-410d-ad7b-8a0ca31cafa3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 56K, 57K, 60K, 65K, SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5afc89de-503c-4248-a011-05b3c8794598.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:03:59 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117599215, 'registration': 'CE71JYW', 'account': 'SPL001', 'make': 'HYUNDAI', 'model': 'IONIQ ELECTRIC HATCHBACK', 'derivative': '100kW Premium 38kWh 5dr Auto', 'mileage': 65315, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2030, 'hall': 'Hall 2', 'transmission': 'automatic', 'firstRegistration': '2021-09-08', 'fuel': 'Electric', 'motExpiry': '2026-10-30', 'doors': 5, 'engineSize': None, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/CE71JYW/2025-12-01/image/92d33d41-fa34-4fcf-b64f-2f4e7914024c_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/45a64c37-13fc-4158-b528-07e004d01b37_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/a14b3027-4e6b-4ec6-9989-4379326e7a0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/9f1d621d-feec-48cc-a636-bf683be6864a_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/94aa9176-a943-476f-a28e-fa2d3e70e81e_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/6a394878-0fcc-4d3b-8d75-281e973afd63_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/75fdded3-9503-4a72-8d3e-a1a7a13fa851_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/1771e36b-af31-40f1-9faa-dc5e38b3888f_removebg.jpg?w=600', 'https://abimg003.imgix.net/CE71JYW/2025-12-01/image/91c58612-fda5-410d-ad7b-8a0ca31cafa3_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'VOSA STATES 56K, 57K, 60K, 65K, SPARE KEY IN OFFICE, Ex-Private Hire', 'virtual': False, 'seller': 'Splend', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5afc89de-503c-4248-a011-05b3c8794598.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b558e53-a67d-55e9-89fe-8d0861e41e8a with identifier: 117599215
2025-12-04 19:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b558e53-a67d-55e9-89fe-8d0861e41e8a with scrape type 2
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b558e53-a67d-55e9-89fe-8d0861e41e8a with scrape type 2
2025-12-04 19:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b558e53-a67d-55e9-89fe-8d0861e41e8a, identifier: 117599215
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4818dd0>
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fe373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600 saved to cache
2025-12-04 19:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd4851190>
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fb5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b558e53-a67d-55e9-89fe-8d0861e41e8a with identifier: 117599215
2025-12-04 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b558e53-a67d-55e9-89fe-8d0861e41e8a with identifier: 117599215
2025-12-04 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 65315, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599215', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ce71jyw', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4b558e53-a67d-55e9-89fe-8d0861e41e8a', 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 105114} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '4b558e53-a67d-55e9-89fe-8d0861e41e8a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ce71jyw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599215',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 65315,
     'odometer_in_km': 105114,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-08',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
2025-12-04 19:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: ELECTRIC_CARS failed for item: 4b558e53-a67d-55e9-89fe-8d0861e41e8a spider: astonbarclay.gb
2025-12-04 19:04:00 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 4b558e53-a67d-55e9-89fe-8d0861e41e8a due to rule: electric_cars.json, error: {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'black', 'original_photo_count': 0, 'seller_name': 'splend', 'price_includes_vat': False, 'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr auto', 'price': 0, 'currency': 'gbp', 'make': 'hyundai', 'model': 'ioniq electric hatchback', 'transmission': 'automatic', 'engine': '', 'fuel_type': 'electric', 'odometer': 65315, 'odometer_reading_unit': 'mi', 'registration_date': '2021-09-08', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599215', 'expiration_date': '2025-12-08t10:00:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '100kw premium 38kwh 5dr auto', 'license_plate': 'ce71jyw', 'year': 2021, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': None, 'emission_standard': 'euro 6', 'is_vat_included': False, 'is_vat_deductible': True, 'id': '4b558e53-a67d-55e9-89fe-8d0861e41e8a', 'current_year_diff': 4, 'age_in_months': 50, 'make_model': 'hyundai ioniq electric hatchback', 'sanitized_make': 'hyundai', 'odometer_in_km': 105114} is not valid under any of the given schemas

Failed validating 'anyOf' in schema['then']:
    {'anyOf': [{'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'gb'}}},
               {'properties': {'make': {'const': 'tesla'},
                               'origin_country_code': {'const': 'uk'}}},
               {'properties': {'origin_country_code': {'const': 'pt'}}},
               {'properties': {'origin_country_code': {'const': 'be'}}}]}

On instance:
    {'age_in_months': 50,
     'auction_title': '',
     'c_o_2_emission_value': None,
     'color': 'black',
     'currency': 'gbp',
     'current_year_diff': 4,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '',
     'expiration_date': '2025-12-08t10:00:00z',
     'fuel_type': 'electric',
     'id': '4b558e53-a67d-55e9-89fe-8d0861e41e8a',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': True,
     'is_vat_included': False,
     'license_plate': 'ce71jyw',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599215',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'hyundai',
     'make_model': 'hyundai ioniq electric hatchback',
     'model': 'ioniq electric hatchback',
     'odometer': 65315,
     'odometer_in_km': 105114,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 0,
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2021-09-08',
     'sanitized_make': 'hyundai',
     'seller_name': 'splend',
     'title': 'hyundai ioniq electric hatchback 100kw premium 38kwh 5dr '
              'auto',
     'transmission': 'automatic',
     'trim': '100kw premium 38kwh 5dr auto',
     'vin': None,
     'year': 2021}
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Electric',
 'id': '4b558e53-a67d-55e9-89fe-8d0861e41e8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'CE71JYW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117599215',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'HYUNDAI',
 'model': 'IONIQ ELECTRIC HATCHBACK',
 'odometer': 65315,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-08',
 'seller_name': 'Splend',
 'title': 'HYUNDAI IONIQ ELECTRIC HATCHBACK 100kW Premium 38kWh 5dr Auto',
 'transmission': 'automatic',
 'trim': '100kW Premium 38kWh 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117599215%27 HTTP/1.1" 200 None
2025-12-04 19:04:00 [astonbarclay.gb] INFO: Saving data for 117599215: {'auction_closing_time': 1765188000.0, 'created_time': 1764442889.663752, 'last_price_update_time': 1764875040.28022}
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117599215') HTTP/1.1" 204 0
2025-12-04 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763614?view=catalogue)
2025-12-04 19:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5a49d90>
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fc325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a17d10>
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b47290>
2025-12-04 19:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:00 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1971
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252Fa775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6a16910>
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252Fe30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b45450>
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F100d1200-2671-45f0-be18-821b567aecea_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117735489?view=catalogue)
2025-12-04 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5ad9850>
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5fa6a90>
2025-12-04 19:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1970
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_6.jpg HTTP/1.1" 201 0
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252F5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6872b10>
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd480b890>
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Ffd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd683dbd0>
2025-12-04 19:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f40410>
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FLP16WNB%252F2025-12-04%252Fimage%252F61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 774e01ff-523b-5b81-8269-e04b52e05313
2025-12-04 19:04:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 774e01ff-523b-5b81-8269-e04b52e05313, skipping ID generation
2025-12-04 19:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 774e01ff-523b-5b81-8269-e04b52e05313 with scrape type 1
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 774e01ff-523b-5b81-8269-e04b52e05313 from tracking dictionaries
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 774e01ff-523b-5b81-8269-e04b52e05313 sending to next pipeline
2025-12-04 19:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 774e01ff-523b-5b81-8269-e04b52e05313, identifier: 117763614
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd488e150>
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg HTTP/1.1" 201 0
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117763847?view=catalogue)
2025-12-04 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117702288?view=catalogue)
2025-12-04 19:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117688144?view=catalogue)
2025-12-04 19:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 774e01ff-523b-5b81-8269-e04b52e05313 with identifier: 117763614
2025-12-04 19:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 774e01ff-523b-5b81-8269-e04b52e05313 with identifier: 117763614
2025-12-04 19:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 774e01ff-523b-5b81-8269-e04b52e05313 with identifier: 117763614 to the API
2025-12-04 19:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '774e01ff-523b-5b81-8269-e04b52e05313',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LP16WNB',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763614',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'LAND ROVER',
 'model': 'DISCOVERY SPORT DIESEL SW',
 'odometer': 44509,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35258,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/86c57bb4-a230-4de0-82f2-58f3fd6c4cf5_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32424,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/f99e5c1b-31d5-41f4-a806-a3e9b9730344_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33655,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/97c0c5d7-4ce3-48e3-9c68-0c4e310c689f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 35268,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/c325a41c-f9f2-46f0-bd10-608ece40a4b0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41497,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/d03f0f8b-7000-4c19-b0df-6b2c5005da0d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50058,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/2e6c8195-72ac-4e55-adea-a2afea7853d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 38078,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/e30011ef-1621-4154-9cbf-d2c660b2827b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_774e01ff-523b-5b81-8269-e04b52e05313/774e01ff-523b-5b81-8269-e04b52e05313_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28946,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/LP16WNB/2025-12-04/image/61443b3f-cb2d-48d3-89b2-0475247345e2_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-24',
 'seller_name': 'Manamanx Ltd',
 'title': 'LAND ROVER DISCOVERY SPORT DIESEL SW 2.0 TD4 180 HSE 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 180 HSE 5dr Auto',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763614%27 HTTP/1.1" 200 None
2025-12-04 19:04:04 [astonbarclay.gb] INFO: Saving data for 117763614: {'created_time': 1764875044.217024, 'last_price_update_time': 1764875044.217034, 'auction_closing_time': 1765215000.0}
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117763614') HTTP/1.1" 204 0
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd47f6e10>
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FOU16CFN%252F2025-12-03%252Fimage%252Fb4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a571678-c46c-5eef-ab52-84fba943364c
2025-12-04 19:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a571678-c46c-5eef-ab52-84fba943364c, skipping ID generation
2025-12-04 19:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a571678-c46c-5eef-ab52-84fba943364c with scrape type 1
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6a571678-c46c-5eef-ab52-84fba943364c from tracking dictionaries
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a571678-c46c-5eef-ab52-84fba943364c sending to next pipeline
2025-12-04 19:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6a571678-c46c-5eef-ab52-84fba943364c, identifier: 117735489
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6b7c290>
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_5.jpg HTTP/1.1" 201 0
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F9553e376-2298-4456-a297-08d31971fea0_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e45190>
2025-12-04 19:04:04 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg HTTP/1.1" 201 0
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6a571678-c46c-5eef-ab52-84fba943364c with identifier: 117735489
2025-12-04 19:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6a571678-c46c-5eef-ab52-84fba943364c with identifier: 117735489
2025-12-04 19:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6a571678-c46c-5eef-ab52-84fba943364c with identifier: 117735489 to the API
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '6a571678-c46c-5eef-ab52-84fba943364c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'OU16CFN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117735489',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'AUDI',
 'model': 'A4 SALOON',
 'odometer': 89378,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28395,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/df5c3d0a-9213-47b2-bc22-0f606e1c5847_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25990,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/1d02b401-39ad-4d8a-8b49-323718f576aa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31673,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/79e6dcaa-3073-48f2-a76b-fec2b10e145a_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 31280,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b5cb5d80-3f1e-4b3a-a614-0ee14f0026d8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40251,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/beedcee9-122c-4b8d-b971-c3766ed01274_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100305,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/e373d878-09ea-41e9-b6a9-e3a07fe9dd69_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86377,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/5d316845-3793-4a33-91ef-9e8285ddd8ee_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 44002,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/fd26f774-5513-4862-8e07-8ddeed8030ce_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a571678-c46c-5eef-ab52-84fba943364c/6a571678-c46c-5eef-ab52-84fba943364c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41421,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/OU16CFN/2025-12-03/image/b4bcf8cf-e048-4504-906e-641f256c8732_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-04',
 'seller_name': 'UKCGR - Select',
 'title': 'AUDI A4 SALOON 2.0T FSI S Line 4dr S Tronic',
 'transmission': 'automatic',
 'trim': '2.0T FSI S Line 4dr S Tronic',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117735489%27 HTTP/1.1" 200 None
2025-12-04 19:04:05 [astonbarclay.gb] INFO: Saving data for 117735489: {'created_time': 1764875045.58745, 'last_price_update_time': 1764875045.587461, 'auction_closing_time': 1765215000.0}
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117735489') HTTP/1.1" 204 0
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4e990>
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Ff3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd8220690>
2025-12-04 19:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1973
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_3.jpg HTTP/1.1" 201 0
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252F7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5e4a9d0>
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1963
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg HTTP/1.1" 201 0
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK17YKG%252F2025-12-04%252Fimage%252F7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb
2025-12-04 19:04:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6730a946-7cb0-5a5d-ad61-d8b076b876eb, skipping ID generation
2025-12-04 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb with scrape type 1
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6730a946-7cb0-5a5d-ad61-d8b076b876eb from tracking dictionaries
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6730a946-7cb0-5a5d-ad61-d8b076b876eb sending to next pipeline
2025-12-04 19:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6730a946-7cb0-5a5d-ad61-d8b076b876eb, identifier: 117763847
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5f95c50>
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FCK66FHR%252F2025-12-04%252Fimage%252F1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item beced978-4d68-5b8d-b104-a91d6c24e3c0
2025-12-04 19:04:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: beced978-4d68-5b8d-b104-a91d6c24e3c0, skipping ID generation
2025-12-04 19:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item beced978-4d68-5b8d-b104-a91d6c24e3c0 with scrape type 1
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Removing item beced978-4d68-5b8d-b104-a91d6c24e3c0 from tracking dictionaries
2025-12-04 19:04:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item beced978-4d68-5b8d-b104-a91d6c24e3c0 sending to next pipeline
2025-12-04 19:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: beced978-4d68-5b8d-b104-a91d6c24e3c0, identifier: 117702288
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd6ab7390>
2025-12-04 19:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1965
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_2.jpg HTTP/1.1" 201 0
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FYB66MGO%252F2025-12-04%252Fimage%252Fa38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65
2025-12-04 19:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 487bcf74-3516-5b0d-8aa5-25a91fea0c65, skipping ID generation
2025-12-04 19:04:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with scrape type 1
2025-12-04 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 487bcf74-3516-5b0d-8aa5-25a91fea0c65 from tracking dictionaries
2025-12-04 19:04:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 487bcf74-3516-5b0d-8aa5-25a91fea0c65 sending to next pipeline
2025-12-04 19:04:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 487bcf74-3516-5b0d-8aa5-25a91fea0c65, identifier: 117688144
2025-12-04 19:04:07 [scrapy.extensions.logstats] INFO: Crawled 279 pages (at 41 pages/min), scraped 185 items (at 44 items/min)
2025-12-04 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6730a946-7cb0-5a5d-ad61-d8b076b876eb with identifier: 117763847
2025-12-04 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6730a946-7cb0-5a5d-ad61-d8b076b876eb with identifier: 117763847
2025-12-04 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 10, 'seller_name': 'manamanx ltd', 'price_includes_vat': False, 'title': 'ssangyong tivoli diesel hatchback 1.6 d ex 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ssangyong', 'model': 'tivoli diesel hatchback', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 70416, 'odometer_reading_unit': 'mi', 'registration_date': '2017-04-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763847', 'expiration_date': '2025-12-08t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.6 d ex 5dr', 'license_plate': 'ck17ykg', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 113, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6730a946-7cb0-5a5d-ad61-d8b076b876eb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33292}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34193}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50302}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40943}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 19330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48299}], 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'ssangyong tivoli diesel hatchback', 'sanitized_make': 'ssangyong', 'odometer_in_km': 113323}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-08t17:30:00z',
     'fuel_type': 'diesel',
     'id': '6730a946-7cb0-5a5d-ad61-d8b076b876eb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ck17ykg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763847',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli diesel hatchback',
     'model': 'tivoli diesel hatchback',
     'odometer': 70416,
     'odometer_in_km': 113323,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37026,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34979,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33292,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34193,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50302,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40943,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50135,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30197,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19330,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48299,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-04-28',
     'sanitized_make': 'ssangyong',
     'seller_name': 'manamanx ltd',
     'title': 'ssangyong tivoli diesel hatchback 1.6 d ex 5dr',
     'transmission': 'manual',
     'trim': '1.6 d ex 5dr',
     'vin': None,
     'year': 2017}
2025-12-04 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_NOT_ALLOWED failed for item: 6730a946-7cb0-5a5d-ad61-d8b076b876eb spider: astonbarclay.gb
2025-12-04 19:04:07 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 6730a946-7cb0-5a5d-ad61-d8b076b876eb due to rule: makes_not_allowed.json, error: False schema does not allow {'auction_title': '', 'is_operable': True, 'is_damaged': False, 'color': 'grey', 'original_photo_count': 10, 'seller_name': 'manamanx ltd', 'price_includes_vat': False, 'title': 'ssangyong tivoli diesel hatchback 1.6 d ex 5dr', 'price': 0, 'currency': 'gbp', 'make': 'ssangyong', 'model': 'tivoli diesel hatchback', 'transmission': 'manual', 'engine': '1.6l', 'fuel_type': 'diesel', 'odometer': 70416, 'odometer_reading_unit': 'mi', 'registration_date': '2017-04-28', 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763847', 'expiration_date': '2025-12-08t17:30:00z', 'location': 'aston barclay chelmsford', 'origin_country_code': 'gb', 'trim': '1.6 d ex 5dr', 'license_plate': 'ck17ykg', 'year': 2017, 'vin': None, 'listing': 'auction', 'doors_number': 5, 'c_o_2_emission_value': 113, 'emission_standard': 'euro 6', 'is_vat_included': True, 'is_vat_deductible': False, 'id': '6730a946-7cb0-5a5d-ad61-d8b076b876eb', 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 37026}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34979}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 33292}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 34193}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50302}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 40943}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 50135}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 30197}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 19330}, {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg', 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600', 'Width': 600, 'Height': 450, 'Extension': 'jpg', 'FileSizeInBytes': 48299}], 'current_year_diff': 8, 'age_in_months': 103, 'make_model': 'ssangyong tivoli diesel hatchback', 'sanitized_make': 'ssangyong', 'odometer_in_km': 113323}

Failed validating None in schema:
    False

On instance:
    {'age_in_months': 103,
     'auction_title': '',
     'c_o_2_emission_value': 113,
     'color': 'grey',
     'currency': 'gbp',
     'current_year_diff': 8,
     'doors_number': 5,
     'emission_standard': 'euro 6',
     'engine': '1.6l',
     'expiration_date': '2025-12-08t17:30:00z',
     'fuel_type': 'diesel',
     'id': '6730a946-7cb0-5a5d-ad61-d8b076b876eb',
     'is_damaged': False,
     'is_operable': True,
     'is_vat_deductible': False,
     'is_vat_included': True,
     'license_plate': 'ck17ykg',
     'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763847',
     'listing': 'auction',
     'location': 'aston barclay chelmsford',
     'make': 'ssangyong',
     'make_model': 'ssangyong tivoli diesel hatchback',
     'model': 'tivoli diesel hatchback',
     'odometer': 70416,
     'odometer_in_km': 113323,
     'odometer_reading_unit': 'mi',
     'origin_country_code': 'gb',
     'original_photo_count': 10,
     'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 37026,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34979,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 33292,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 34193,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50302,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 40943,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 50135,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 30197,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 19330,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600',
                 'Width': 600},
                {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg',
                 'Extension': 'jpg',
                 'FileSizeInBytes': 48299,
                 'Height': 450,
                 'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600',
                 'Width': 600}],
     'price': 0,
     'price_includes_vat': False,
     'registration_date': '2017-04-28',
     'sanitized_make': 'ssangyong',
     'seller_name': 'manamanx ltd',
     'title': 'ssangyong tivoli diesel hatchback 1.6 d ex 5dr',
     'transmission': 'manual',
     'trim': '1.6 d ex 5dr',
     'vin': None,
     'year': 2017}
{'auction_title': '',
 'c_o_2_emission_value': 113,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': '6730a946-7cb0-5a5d-ad61-d8b076b876eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CK17YKG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117763847',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'SSANGYONG',
 'model': 'TIVOLI DIESEL HATCHBACK',
 'odometer': 70416,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 10,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37026,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/4fd08fdd-3452-41b8-a31b-9bcab55fa25f_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34979,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/551648b2-f7f4-4370-b93c-9502f7079073_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33292,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/795cf444-d770-466c-a065-ceb29af564b9_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 34193,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/100d1200-2671-45f0-be18-821b567aecea_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50302,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/3e86cbcf-8f3a-47c3-99d2-7a0f831104d3_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40943,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/41637637-814a-45b6-9a44-03e1a2a9876d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50135,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8b33ae0b-8d64-4125-8e0b-8430510ecd89_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 30197,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/76787682-b73d-40f4-b2e2-b1674571f993_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 19330,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/8d301b8e-e28b-46e2-b64c-d5d61fa785d2_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6730a946-7cb0-5a5d-ad61-d8b076b876eb/6730a946-7cb0-5a5d-ad61-d8b076b876eb_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48299,
             'Height': 450,
             'OriginUrl': 'https://abimg003.imgix.net/CK17YKG/2025-12-04/image/7580c550-053a-48bb-a6c7-078bcc8120be_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-28',
 'seller_name': 'Manamanx Ltd',
 'title': 'SSANGYONG TIVOLI DIESEL HATCHBACK 1.6 D EX 5dr',
 'transmission': 'manual',
 'trim': '1.6 D EX 5dr',
 'vin': None,
 'year': 2017}
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117763847%27 HTTP/1.1" 200 None
2025-12-04 19:04:07 [astonbarclay.gb] INFO: Saving data for 117763847: {'created_time': 1764875047.515398, 'last_price_update_time': 1764875047.515408, 'auction_closing_time': 1765215000.0}
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117763847') HTTP/1.1" 204 0
2025-12-04 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: beced978-4d68-5b8d-b104-a91d6c24e3c0 with identifier: 117702288
2025-12-04 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: beced978-4d68-5b8d-b104-a91d6c24e3c0 with identifier: 117702288
2025-12-04 19:04:07 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: beced978-4d68-5b8d-b104-a91d6c24e3c0 with identifier: 117702288 to the API
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Diesel',
 'id': 'beced978-4d68-5b8d-b104-a91d6c24e3c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'CK66FHR',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117702288',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'FORD',
 'model': 'FOCUS HATCHBACK SPECIAL EDITIONS',
 'odometer': 67530,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 28933,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/b5e02a57-f228-4067-af5d-d245d332af7b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25177,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/8c8b2c9a-0229-4a7e-a7fc-3e40aa5eb521_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26112,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/1c43910a-d514-4e49-9d8f-4cb9dd908d5c_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 27619,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/0967ca92-cd95-4682-bc81-cdcfdebc977b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41411,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/7e80afee-7773-40ab-a3ae-2c55a9a48995_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85020,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/9600ccdf-cfb6-434e-a4f8-d41b5af14bfc_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85948,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/ea2c0fa0-f9c2-4bc9-ade8-ee23b7748fe0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45124,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/a775ba30-b835-4db5-9bbb-ac74089eac1d_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_beced978-4d68-5b8d-b104-a91d6c24e3c0/beced978-4d68-5b8d-b104-a91d6c24e3c0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42743,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/CK66FHR/2025-12-04/image/2848f77f-d587-438b-85ca-d4669baab2d4_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'FORD FOCUS HATCHBACK SPECIAL EDITIONS 2.0 TDCi Zetec S Red 5dr',
 'transmission': 'manual',
 'trim': '2.0 TDCi Zetec S Red 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117702288%27 HTTP/1.1" 200 None
2025-12-04 19:04:07 [astonbarclay.gb] INFO: Saving data for 117702288: {'created_time': 1764875047.940492, 'last_price_update_time': 1764875047.940503, 'auction_closing_time': 1765215000.0}
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117702288') HTTP/1.1" 204 0
2025-12-04 19:04:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with identifier: 117688144
2025-12-04 19:04:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with identifier: 117688144
2025-12-04 19:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 487bcf74-3516-5b0d-8aa5-25a91fea0c65 with identifier: 117688144 to the API
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 145,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-08T17:30:00Z',
 'fuel_type': 'Petrol',
 'id': '487bcf74-3516-5b0d-8aa5-25a91fea0c65',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YB66MGO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117688144',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 71526,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 9,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26467,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/f3c5b5d7-3385-4143-9545-65408e703d20_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 22658,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/826494d7-46a3-4805-99db-de7c2555b72b_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 26769,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a38d1ce9-0549-4698-b9b1-2af3cbcb3773_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 25107,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/7fd24b69-e80f-452f-97f4-03a4ca464589_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 43077,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/6561bcb2-f200-4e0a-becf-cd82171f46fa_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89582,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/9553e376-2298-4456-a297-08d31971fea0_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77836,
             'Height': 960,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/a43c3346-b0b3-4489-9aa7-0e4acb92f911_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49697,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/2717ca2a-f60c-4333-aa2d-304d27402bd8_removebg.jpg?w=600',
             'Width': 600},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_487bcf74-3516-5b0d-8aa5-25a91fea0c65/487bcf74-3516-5b0d-8aa5-25a91fea0c65_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46151,
             'Height': 375,
             'OriginUrl': 'https://abimg003.imgix.net/YB66MGO/2025-12-04/image/0f5d6dbe-5abd-4328-b983-219b4f15eaf8_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-08',
 'seller_name': 'TCB Group - Prime',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 2.0 TSI GTI 5dr DSG [Nav]',
 'transmission': 'automatic',
 'trim': '2.0 TSI GTI 5dr DSG [Nav]',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117688144%27 HTTP/1.1" 200 None
2025-12-04 19:04:08 [astonbarclay.gb] INFO: Saving data for 117688144: {'created_time': 1764875048.325366, 'last_price_update_time': 1764875048.325376, 'auction_closing_time': 1765215000.0}
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117688144') HTTP/1.1" 204 0
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507378?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117517620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117316150?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407455?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117122763?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554620?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:08 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507378, 'registration': 'DC23JUX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23292, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2005, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUX/2025-11-28/image/c7a7799d-72fb-401f-82db-1b59c34264ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/f638aa64-3a28-422a-8dee-6cabe17d0972_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/97dd0646-7d45-4723-9060-0ec1c00ffaaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/6c1db36f-b8aa-4adc-88c3-0a9a06654d3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/34bbd48e-b350-45eb-9107-17e804973082_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/9d2e6021-5197-49ff-b6b5-44611f54bbef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/9239d395-2a21-4397-a9da-0f9ed9ac10d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/5f89ef8b-6c63-420a-baf5-ac60d3b41ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/6c82d3f7-2424-4f0d-bfc0-8a60bae74247_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25-14K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9030786-56a8-4b8e-8e39-17be00bc24bf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:08 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507378, 'registration': 'DC23JUX', 'account': 'ACC015', 'make': 'VOLKSWAGEN', 'model': 'GOLF HATCHBACK', 'derivative': '1.5 TSI 150 Life 5dr', 'mileage': 23292, 'mileageWarranty': True, 'type': 'car', 'saleId': 17986, 'siteId': 1, 'site': {'id': 1, 'name': 'Aston Barclay Chelmsford', 'vehicles': 501}, 'saleStart': '2025-12-08T10:00Z', 'lot': 2005, 'hall': 'Hall 2', 'transmission': 'manual', 'firstRegistration': '2023-07-28', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DC23JUX/2025-11-28/image/c7a7799d-72fb-401f-82db-1b59c34264ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/f638aa64-3a28-422a-8dee-6cabe17d0972_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/97dd0646-7d45-4723-9060-0ec1c00ffaaa_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/6c1db36f-b8aa-4adc-88c3-0a9a06654d3e_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/34bbd48e-b350-45eb-9107-17e804973082_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/9d2e6021-5197-49ff-b6b5-44611f54bbef_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/9239d395-2a21-4397-a9da-0f9ed9ac10d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/5f89ef8b-6c63-420a-baf5-ac60d3b41ced_removebg.jpg?w=600', 'https://abimg003.imgix.net/DC23JUX/2025-11-28/image/6c82d3f7-2424-4f0d-bfc0-8a60bae74247_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 05/25-14K', 'remarks': 'SPARE KEY IN OFFICE', 'virtual': False, 'seller': 'Accident Exchange', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 126, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b9030786-56a8-4b8e-8e39-17be00bc24bf.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a6fbef-e6c1-5219-92eb-0a556638755f with identifier: 117507378
2025-12-04 19:04:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a6fbef-e6c1-5219-92eb-0a556638755f with scrape type 2
2025-12-04 19:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a6fbef-e6c1-5219-92eb-0a556638755f with scrape type 2
2025-12-04 19:04:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d2a6fbef-e6c1-5219-92eb-0a556638755f, identifier: 117507378
2025-12-04 19:04:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d2a6fbef-e6c1-5219-92eb-0a556638755f with identifier: 117507378
2025-12-04 19:04:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d2a6fbef-e6c1-5219-92eb-0a556638755f with identifier: 117507378
2025-12-04 19:04:08 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d2a6fbef-e6c1-5219-92eb-0a556638755f with identifier: 117507378 to the API
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d2a6fbef-e6c1-5219-92eb-0a556638755f%27 HTTP/1.1" 200 None
2025-12-04 19:04:08 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d2a6fbef-e6c1-5219-92eb-0a556638755f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:07 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507378?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 126,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-08T10:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd2a6fbef-e6c1-5219-92eb-0a556638755f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'DC23JUX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507378',
 'listing': 'auction',
 'location': 'Aston Barclay Chelmsford',
 'make': 'VOLKSWAGEN',
 'model': 'GOLF HATCHBACK',
 'odometer': 23292,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-28',
 'seller_name': 'Accident Exchange',
 'title': 'VOLKSWAGEN GOLF HATCHBACK 1.5 TSI 150 Life 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI 150 Life 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507378%27 HTTP/1.1" 200 None
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Saving data for 117507378: {'auction_closing_time': 1765188000.0, 'created_time': 1764320469.878197, 'last_price_update_time': 1764875049.00445}
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507378') HTTP/1.1" 204 0
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117517620, 'registration': 'SK18FXH', 'account': 'ARN037', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.6 E-torQ Pop Star 5dr', 'mileage': 93818, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SK18FXH/2025-12-04/image/954da863-2f1c-4887-80af-c47948756a71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/eadcd749-90e8-4f74-93cf-b047b058d9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/f1ab7ffb-4dd3-48b7-927d-a3109d7ca0aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/1fe69272-8f5c-4d32-b6ea-1cf0b08c10cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/88c986f1-3fe6-45fd-a242-0003bb5e7c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/519813fd-cb7d-4289-abae-86cf42e290ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/ff2afba4-3ee3-441f-84f2-ab8a54760819_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/784132d1-4a10-4097-8968-ecb1456d69f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/0e5d5ee3-89c4-4831-80b8-42a3bb5678f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/d1a0157f-071b-4b8f-be46-f1538b9aacdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/2a1c5273-c021-454c-974a-badcf17e50c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/ef572ef0-1f9f-40ac-a368-47ae3461c21e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/d9aa063d-f7b5-4436-9202-ba1e00199bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/7b19084b-fafc-4e9a-9504-ba24d785f950_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/818d5b54-4c98-462b-a1f6-bd5ee726123b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/b324e0d9-3a5a-443f-b400-d28b64700e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/98c43ebd-b0c4-4660-8033-95b0b9dfd347_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/af7b1712-c357-48fd-89a7-506155cc97ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19-3K, 03/20-9K, 02/21-12K, 02/22-27K, 03/23-47K, 11/23-60K', 'remarks': 'vosa@ 12k, 27k, 47k, 64k, 82k SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5d795f4-c670-4a3b-a283-221a5c2fb47a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117517620, 'registration': 'SK18FXH', 'account': 'ARN037', 'make': 'FIAT', 'model': '500X HATCHBACK', 'derivative': '1.6 E-torQ Pop Star 5dr', 'mileage': 93818, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-03-09', 'fuel': 'Petrol', 'motExpiry': '2026-03-10', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SK18FXH/2025-12-04/image/954da863-2f1c-4887-80af-c47948756a71_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/eadcd749-90e8-4f74-93cf-b047b058d9ac_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/f1ab7ffb-4dd3-48b7-927d-a3109d7ca0aa_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/1fe69272-8f5c-4d32-b6ea-1cf0b08c10cd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/88c986f1-3fe6-45fd-a242-0003bb5e7c69_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/519813fd-cb7d-4289-abae-86cf42e290ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/ff2afba4-3ee3-441f-84f2-ab8a54760819_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/784132d1-4a10-4097-8968-ecb1456d69f1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/0e5d5ee3-89c4-4831-80b8-42a3bb5678f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/d1a0157f-071b-4b8f-be46-f1538b9aacdb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/2a1c5273-c021-454c-974a-badcf17e50c6_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/ef572ef0-1f9f-40ac-a368-47ae3461c21e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/d9aa063d-f7b5-4436-9202-ba1e00199bf1_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/7b19084b-fafc-4e9a-9504-ba24d785f950_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/818d5b54-4c98-462b-a1f6-bd5ee726123b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/b324e0d9-3a5a-443f-b400-d28b64700e59_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/98c43ebd-b0c4-4660-8033-95b0b9dfd347_removebg.jpg?w=600', 'https://abimg003.imgix.net/SK18FXH/2025-12-04/image/af7b1712-c357-48fd-89a7-506155cc97ec_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/19-3K, 03/20-9K, 02/21-12K, 02/22-27K, 03/23-47K, 11/23-60K', 'remarks': 'vosa@ 12k, 27k, 47k, 64k, 82k SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 147, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/c5d795f4-c670-4a3b-a283-221a5c2fb47a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b06350a8-ade8-5a00-9a7e-2fccd24294c5 with identifier: 117517620
2025-12-04 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b06350a8-ade8-5a00-9a7e-2fccd24294c5 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b06350a8-ade8-5a00-9a7e-2fccd24294c5 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b06350a8-ade8-5a00-9a7e-2fccd24294c5, identifier: 117517620
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117316150, 'registration': 'KR73WUX', 'account': 'IMG001', 'make': 'SEAT', 'model': 'TARRACO ESTATE', 'derivative': '1.5 EcoTSI FR Sport 5dr DSG', 'mileage': 10817, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-12-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR73WUX/2025-11-19/image/14969d8d-02b7-4f00-843c-f52f3511906a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/07025e20-b1aa-44b1-834d-12c124ff1707_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/89c07184-533c-4c7c-99b5-a6698814b228_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/c7be632f-fccd-4d8d-8877-fdd2abf0c411_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/395eacac-b9f5-4260-b82a-aed08466b88a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/21505e93-3cf2-4ed7-91dc-cd46b6b9efd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/dc2bf002-0f2f-42a5-9fb8-2111d0e990b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/f71d830a-4e45-4bf4-ac4e-4a77a8531178_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/24- 9.7k, 10/25- 9.9k', 'remarks': 'spare key', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9edb2344-2c47-492d-a6e7-5a89777f3dad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117316150, 'registration': 'KR73WUX', 'account': 'IMG001', 'make': 'SEAT', 'model': 'TARRACO ESTATE', 'derivative': '1.5 EcoTSI FR Sport 5dr DSG', 'mileage': 10817, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2023-12-01', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 1498, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/KR73WUX/2025-11-19/image/14969d8d-02b7-4f00-843c-f52f3511906a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/07025e20-b1aa-44b1-834d-12c124ff1707_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/89c07184-533c-4c7c-99b5-a6698814b228_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/c7be632f-fccd-4d8d-8877-fdd2abf0c411_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/395eacac-b9f5-4260-b82a-aed08466b88a_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/21505e93-3cf2-4ed7-91dc-cd46b6b9efd2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/dc2bf002-0f2f-42a5-9fb8-2111d0e990b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR73WUX/2025-11-19/image/f71d830a-4e45-4bf4-ac4e-4a77a8531178_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 07/24- 9.7k, 10/25- 9.9k', 'remarks': 'spare key', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 162, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9edb2344-2c47-492d-a6e7-5a89777f3dad.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50544cfb-637c-5f65-8179-61acc59c7905 with identifier: 117316150
2025-12-04 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50544cfb-637c-5f65-8179-61acc59c7905 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50544cfb-637c-5f65-8179-61acc59c7905 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 50544cfb-637c-5f65-8179-61acc59c7905, identifier: 117316150
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407455, 'registration': 'YR69YHV', 'account': 'ARN099', 'make': 'KIA', 'model': 'SORENTO DIESEL STATION WAGON', 'derivative': '2.2 CRDi KX-3 5dr Auto', 'mileage': 53282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-20', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YR69YHV/2025-11-26/image/3f8b6349-b594-4073-b5a1-a52aaf328dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/bf27fb34-7628-4e16-bc6b-21b0504689d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/40a808cf-d5d0-4eb9-bdd9-f944e18dd86b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/6263ee47-6e41-41db-9e5d-743aafb90648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/773902df-80da-42e1-80d9-6ed6792384e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/71dbb24f-0db8-4196-a11b-1eb3d853bcb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/56e39379-8e62-427f-bb2b-87eb96bc222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/fa40c332-f137-4239-8422-96cdba1c1557_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/8d76c53e-abe2-407b-900b-d66f1da739b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/a668e5cb-1e5e-400d-a0b8-25afbfec29b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/96827af3-4bbb-4a07-9179-395cd96ae61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/2475688a-056e-4cf6-9f14-c2113fb8c92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/02788cd2-ae16-47a4-90b2-a93adbdb0947_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20- 7k, 11/21- 16k, 10/22- 25k, 09/23- 35k, 04/24- 40k, 10/25- 53k,', 'remarks': 'VOSA@ 25k, 31k, 40k, 49k spare key, sd card', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef383072-c013-428c-b48c-ea79a7473c48.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407455, 'registration': 'YR69YHV', 'account': 'ARN099', 'make': 'KIA', 'model': 'SORENTO DIESEL STATION WAGON', 'derivative': '2.2 CRDi KX-3 5dr Auto', 'mileage': 53282, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2019-10-11', 'fuel': 'Diesel', 'motExpiry': '2026-04-20', 'doors': 5, 'engineSize': 2199, 'bodyType': 'Station Wagon', 'images': ['https://abimg003.imgix.net/YR69YHV/2025-11-26/image/3f8b6349-b594-4073-b5a1-a52aaf328dc2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/bf27fb34-7628-4e16-bc6b-21b0504689d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/40a808cf-d5d0-4eb9-bdd9-f944e18dd86b_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/6263ee47-6e41-41db-9e5d-743aafb90648_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/773902df-80da-42e1-80d9-6ed6792384e9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/71dbb24f-0db8-4196-a11b-1eb3d853bcb8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/56e39379-8e62-427f-bb2b-87eb96bc222f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/fa40c332-f137-4239-8422-96cdba1c1557_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/8d76c53e-abe2-407b-900b-d66f1da739b9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/a668e5cb-1e5e-400d-a0b8-25afbfec29b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/96827af3-4bbb-4a07-9179-395cd96ae61f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/2475688a-056e-4cf6-9f14-c2113fb8c92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YR69YHV/2025-11-26/image/02788cd2-ae16-47a4-90b2-a93adbdb0947_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/20- 7k, 11/21- 16k, 10/22- 25k, 09/23- 35k, 04/24- 40k, 10/25- 53k,', 'remarks': 'VOSA@ 25k, 31k, 40k, 49k spare key, sd card', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 158, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/ef383072-c013-428c-b48c-ea79a7473c48.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 913a7b6b-8cd6-5f51-aac9-9890f155add4 with identifier: 117407455
2025-12-04 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 913a7b6b-8cd6-5f51-aac9-9890f155add4 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 913a7b6b-8cd6-5f51-aac9-9890f155add4 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 913a7b6b-8cd6-5f51-aac9-9890f155add4, identifier: 117407455
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117122763, 'registration': 'WV67VDL', 'account': 'IMG001', 'make': 'ALFA ROMEO', 'model': 'STELVIO ESTATE SPECIAL EDITION', 'derivative': '2.2 D 210 Milano 5dr Auto', 'mileage': 57875, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-09-04', 'fuel': 'Diesel', 'motExpiry': '2026-09-06', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WV67VDL/2025-11-12/image/9e4e1836-a16f-46d8-91a1-ba08067cbd51_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/1cddd0bf-4013-4411-a620-3cf52369181a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/e0f4fbab-98af-4dfe-aacb-99af10a55240_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/0017e8e3-8325-4311-a430-9cf72a521e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/373d8329-a1d5-45f4-a35f-f45d92bca21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/41f4dcb2-870d-4d25-8a17-dc7ef12d12b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/f5fb6935-3b58-47b9-9e5e-68b0655a824e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/38985f2b-c929-4c93-9cac-b3838a172380_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/18-11K, 03/19-11K, 03/20-19K, 03/21-24K, 08/22-31K, 08/23-33K, 08/24-42K, 05/25-53K', 'remarks': 'vosa@ 21k, 27k, 32k, 33k, 42k, 55k SPARE KEY IN OFFICE / FRONT PAGE OF V5 ONLY', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 127, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/91332979-299a-4d82-a637-599c22adf2dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117122763, 'registration': 'WV67VDL', 'account': 'IMG001', 'make': 'ALFA ROMEO', 'model': 'STELVIO ESTATE SPECIAL EDITION', 'derivative': '2.2 D 210 Milano 5dr Auto', 'mileage': 57875, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-09-04', 'fuel': 'Diesel', 'motExpiry': '2026-09-06', 'doors': 5, 'engineSize': 2143, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WV67VDL/2025-11-12/image/9e4e1836-a16f-46d8-91a1-ba08067cbd51_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/1cddd0bf-4013-4411-a620-3cf52369181a_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/e0f4fbab-98af-4dfe-aacb-99af10a55240_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/0017e8e3-8325-4311-a430-9cf72a521e70_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/373d8329-a1d5-45f4-a35f-f45d92bca21b_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/41f4dcb2-870d-4d25-8a17-dc7ef12d12b1_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/f5fb6935-3b58-47b9-9e5e-68b0655a824e_removebg.jpg?w=600', 'https://abimg003.imgix.net/WV67VDL/2025-11-12/image/38985f2b-c929-4c93-9cac-b3838a172380_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/18-11K, 03/19-11K, 03/20-19K, 03/21-24K, 08/22-31K, 08/23-33K, 08/24-42K, 05/25-53K', 'remarks': 'vosa@ 21k, 27k, 32k, 33k, 42k, 55k SPARE KEY IN OFFICE / FRONT PAGE OF V5 ONLY', 'virtual': True, 'seller': 'IMG Seat', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': False, 'v5details': None, 'co2': 127, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/91332979-299a-4d82-a637-599c22adf2dd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 817b5a25-1d04-5b77-ad8c-88d37479f257 with identifier: 117122763
2025-12-04 19:04:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 817b5a25-1d04-5b77-ad8c-88d37479f257 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 817b5a25-1d04-5b77-ad8c-88d37479f257 with scrape type 2
2025-12-04 19:04:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 817b5a25-1d04-5b77-ad8c-88d37479f257, identifier: 117122763
2025-12-04 19:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b06350a8-ade8-5a00-9a7e-2fccd24294c5 with identifier: 117517620
2025-12-04 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b06350a8-ade8-5a00-9a7e-2fccd24294c5 with identifier: 117517620
2025-12-04 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 150985 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150985
2025-12-04 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: b06350a8-ade8-5a00-9a7e-2fccd24294c5 spider: astonbarclay.gb
2025-12-04 19:04:09 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: b06350a8-ade8-5a00-9a7e-2fccd24294c5 due to rule: high_mileage_for_country.json, error: 150985 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    150985
{'auction_title': '',
 'c_o_2_emission_value': 147,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b06350a8-ade8-5a00-9a7e-2fccd24294c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SK18FXH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117517620',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'FIAT',
 'model': '500X HATCHBACK',
 'odometer': 93818,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-09',
 'seller_name': 'Arnold Clark',
 'title': 'FIAT 500X HATCHBACK 1.6 E-torQ Pop Star 5dr',
 'transmission': 'manual',
 'trim': '1.6 E-torQ Pop Star 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117517620%27 HTTP/1.1" 200 None
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Saving data for 117517620: {'auction_closing_time': 1764939600.0, 'created_time': 1764184277.36456, 'last_price_update_time': 1764875049.649718}
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117517620') HTTP/1.1" 204 0
2025-12-04 19:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 50544cfb-637c-5f65-8179-61acc59c7905 with identifier: 117316150
2025-12-04 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 50544cfb-637c-5f65-8179-61acc59c7905 with identifier: 117316150
2025-12-04 19:04:09 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 50544cfb-637c-5f65-8179-61acc59c7905 with identifier: 117316150 to the API
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2750544cfb-637c-5f65-8179-61acc59c7905%27 HTTP/1.1" 200 None
2025-12-04 19:04:09 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 50544cfb-637c-5f65-8179-61acc59c7905: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:08 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117316150?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '50544cfb-637c-5f65-8179-61acc59c7905',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR73WUX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117316150',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'SEAT',
 'model': 'TARRACO ESTATE',
 'odometer': 10817,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-01',
 'seller_name': 'IMG Seat',
 'title': 'SEAT TARRACO ESTATE 1.5 EcoTSI FR Sport 5dr DSG',
 'transmission': 'automatic',
 'trim': '1.5 EcoTSI FR Sport 5dr DSG',
 'vin': None,
 'year': 2023}
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117316150%27 HTTP/1.1" 200 None
2025-12-04 19:04:09 [astonbarclay.gb] INFO: Saving data for 117316150: {'auction_closing_time': 1764939600.0, 'created_time': 1763492561.899732, 'last_price_update_time': 1764875049.941447}
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117316150') HTTP/1.1" 204 0
2025-12-04 19:04:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 913a7b6b-8cd6-5f51-aac9-9890f155add4 with identifier: 117407455
2025-12-04 19:04:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 913a7b6b-8cd6-5f51-aac9-9890f155add4 with identifier: 117407455
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 913a7b6b-8cd6-5f51-aac9-9890f155add4 with identifier: 117407455 to the API
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27913a7b6b-8cd6-5f51-aac9-9890f155add4%27 HTTP/1.1" 200 None
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 913a7b6b-8cd6-5f51-aac9-9890f155add4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:09 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117407455?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '913a7b6b-8cd6-5f51-aac9-9890f155add4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YR69YHV',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407455',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'KIA',
 'model': 'SORENTO DIESEL STATION WAGON',
 'odometer': 53282,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-11',
 'seller_name': 'Arnold Clark',
 'title': 'KIA SORENTO DIESEL STATION WAGON 2.2 CRDi KX-3 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 CRDi KX-3 5dr Auto',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407455%27 HTTP/1.1" 200 None
2025-12-04 19:04:10 [astonbarclay.gb] INFO: Saving data for 117407455: {'auction_closing_time': 1764939600.0, 'created_time': 1763751811.402198, 'last_price_update_time': 1764875050.297183}
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407455') HTTP/1.1" 204 0
2025-12-04 19:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 817b5a25-1d04-5b77-ad8c-88d37479f257 with identifier: 117122763
2025-12-04 19:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 817b5a25-1d04-5b77-ad8c-88d37479f257 with identifier: 117122763
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 817b5a25-1d04-5b77-ad8c-88d37479f257 with identifier: 117122763 to the API
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27817b5a25-1d04-5b77-ad8c-88d37479f257%27 HTTP/1.1" 200 None
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 817b5a25-1d04-5b77-ad8c-88d37479f257: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:09 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117122763?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 127,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.1L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '817b5a25-1d04-5b77-ad8c-88d37479f257',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WV67VDL',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117122763',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'ALFA ROMEO',
 'model': 'STELVIO ESTATE SPECIAL EDITION',
 'odometer': 57875,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-09-04',
 'seller_name': 'IMG Seat',
 'title': 'ALFA ROMEO STELVIO ESTATE SPECIAL EDITION 2.2 D 210 Milano 5dr Auto',
 'transmission': 'automatic',
 'trim': '2.2 D 210 Milano 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117122763%27 HTTP/1.1" 200 None
2025-12-04 19:04:10 [astonbarclay.gb] INFO: Saving data for 117122763: {'auction_closing_time': 1764939600.0, 'created_time': 1762887731.46701, 'last_price_update_time': 1764875050.594715}
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117122763') HTTP/1.1" 204 0
2025-12-04 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117407486?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117554606?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:10 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554620, 'registration': 'SV19HVE', 'account': 'ARN134', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE', 'derivative': '1.5 [132] SE-L Nav+ 2dr', 'mileage': 22296, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 2, 'engineSize': 1496, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/SV19HVE/2025-12-02/image/0071cb59-fce2-489d-978b-3e31db1398cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/36e87232-64fe-4ffa-aa25-b88a1b9ca4ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/7a12d216-6bb1-49da-a5ed-41fda7a1b675_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/3b1e43ff-453b-483b-8965-adf14b51e53a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/eefc2c7f-9502-4c83-93d2-26093e5e9f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/87ee7b1e-049d-4191-a500-b504464c4190_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/865892ef-b43b-4e10-806f-69e94ce4b03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/60806b1c-bff5-4227-b342-630a412de641_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/423320e2-d428-4c33-bddf-4c5c2ad1a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/4646cf7f-5290-4ab5-8941-ccd7f74690cf_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/20-6k 07/21-10k 05/23-11k 11/24-17k', 'remarks': 'vosa@ 11k, 11k, 17k, 22k spare key in office x2', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1ddd38-e3eb-4c48-a4b8-1d1164176d42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:10 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554620, 'registration': 'SV19HVE', 'account': 'ARN134', 'make': 'MAZDA', 'model': 'MX-5 CONVERTIBLE', 'derivative': '1.5 [132] SE-L Nav+ 2dr', 'mileage': 22296, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-10', 'fuel': 'Petrol', 'motExpiry': '2026-11-17', 'doors': 2, 'engineSize': 1496, 'bodyType': 'Convertible', 'images': ['https://abimg003.imgix.net/SV19HVE/2025-12-02/image/0071cb59-fce2-489d-978b-3e31db1398cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/36e87232-64fe-4ffa-aa25-b88a1b9ca4ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/7a12d216-6bb1-49da-a5ed-41fda7a1b675_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/3b1e43ff-453b-483b-8965-adf14b51e53a_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/eefc2c7f-9502-4c83-93d2-26093e5e9f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/87ee7b1e-049d-4191-a500-b504464c4190_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/865892ef-b43b-4e10-806f-69e94ce4b03f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/60806b1c-bff5-4227-b342-630a412de641_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/423320e2-d428-4c33-bddf-4c5c2ad1a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/SV19HVE/2025-12-02/image/4646cf7f-5290-4ab5-8941-ccd7f74690cf_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 06/20-6k 07/21-10k 05/23-11k 11/24-17k', 'remarks': 'vosa@ 11k, 11k, 17k, 22k spare key in office x2', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 138, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/9c1ddd38-e3eb-4c48-a4b8-1d1164176d42.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 861c75d8-84ce-5235-aac0-2d33da2c93a4 with identifier: 117554620
2025-12-04 19:04:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 861c75d8-84ce-5235-aac0-2d33da2c93a4 with scrape type 2
2025-12-04 19:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 861c75d8-84ce-5235-aac0-2d33da2c93a4 with scrape type 2
2025-12-04 19:04:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 861c75d8-84ce-5235-aac0-2d33da2c93a4, identifier: 117554620
2025-12-04 19:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 861c75d8-84ce-5235-aac0-2d33da2c93a4 with identifier: 117554620
2025-12-04 19:04:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 861c75d8-84ce-5235-aac0-2d33da2c93a4 with identifier: 117554620
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 861c75d8-84ce-5235-aac0-2d33da2c93a4 with identifier: 117554620 to the API
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27861c75d8-84ce-5235-aac0-2d33da2c93a4%27 HTTP/1.1" 200 None
2025-12-04 19:04:10 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 861c75d8-84ce-5235-aac0-2d33da2c93a4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554620?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 138,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 2,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '861c75d8-84ce-5235-aac0-2d33da2c93a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SV19HVE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554620',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'MAZDA',
 'model': 'MX-5 CONVERTIBLE',
 'odometer': 22296,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-10',
 'seller_name': 'Arnold Clark',
 'title': 'MAZDA MX-5 CONVERTIBLE 1.5 [132] SE-L Nav+ 2dr',
 'transmission': 'manual',
 'trim': '1.5 [132] SE-L Nav+ 2dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554620%27 HTTP/1.1" 200 None
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Saving data for 117554620: {'auction_closing_time': 1764939600.0, 'created_time': 1764270309.279192, 'last_price_update_time': 1764875051.022588}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554620') HTTP/1.1" 204 0
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117407486, 'registration': 'SJ70WZM', 'account': 'ARN017', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 130 GT Line 5dr EAT8', 'mileage': 63971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/681746e2-2c75-4653-b242-23dc1e4f07ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/741129ad-4a49-4247-9e2c-9a2221f3317e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b9a771b6-3d53-452a-865c-78582bc903d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/a566195b-5ee4-426c-a6a8-bd8c2b90ea0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b82807b7-9ead-42a8-b517-7495615d2eec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/9bb64d63-fdb5-4b9e-b762-d02c5cba799b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/a9616616-1ab4-4322-b39b-899018d2abf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b4e290ba-5d9b-48c0-a876-c20d9a0020fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/3f04c236-95a2-4bbf-88e0-96f217d147ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/f38fbfdb-f0bc-40dc-8a82-80d84f55ee98_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/21-387 miles, 11/24- 50k, 01/25- 53k, 03/25- ?', 'remarks': 'vosa@ 27k, 47k, 62k, spare key', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e6ce45a-af95-4b03-9796-fac4663248b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117407486, 'registration': 'SJ70WZM', 'account': 'ARN017', 'make': 'PEUGEOT', 'model': '208 HATCHBACK', 'derivative': '1.2 PureTech 130 GT Line 5dr EAT8', 'mileage': 63971, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-09-24', 'fuel': 'Petrol', 'motExpiry': '2026-09-23', 'doors': 5, 'engineSize': 1200, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/681746e2-2c75-4653-b242-23dc1e4f07ed_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/741129ad-4a49-4247-9e2c-9a2221f3317e_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b9a771b6-3d53-452a-865c-78582bc903d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/a566195b-5ee4-426c-a6a8-bd8c2b90ea0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b82807b7-9ead-42a8-b517-7495615d2eec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/9bb64d63-fdb5-4b9e-b762-d02c5cba799b_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/a9616616-1ab4-4322-b39b-899018d2abf2_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/b4e290ba-5d9b-48c0-a876-c20d9a0020fd_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/3f04c236-95a2-4bbf-88e0-96f217d147ec_removebg.jpg?w=600', 'https://abimg003.imgix.net/SJ70WZM/2025-11-26/image/f38fbfdb-f0bc-40dc-8a82-80d84f55ee98_removebg.jpg?w=600'], 'colour': 'YELLOW', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 09/21-387 miles, 11/24- 50k, 01/25- 53k, 03/25- ?', 'remarks': 'vosa@ 27k, 47k, 62k, spare key', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 128, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2e6ce45a-af95-4b03-9796-fac4663248b8.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83bbc862-f0c3-5686-a7ae-d16f7250a18c with identifier: 117407486
2025-12-04 19:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83bbc862-f0c3-5686-a7ae-d16f7250a18c with scrape type 2
2025-12-04 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83bbc862-f0c3-5686-a7ae-d16f7250a18c with scrape type 2
2025-12-04 19:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 83bbc862-f0c3-5686-a7ae-d16f7250a18c, identifier: 117407486
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117554606, 'registration': 'YP67UAM', 'account': 'ARN185', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic', 'mileage': 68697, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP67UAM/2025-12-02/image/edf1e32f-43ff-4fc4-a43b-52fa4bde0365_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/767f9a2c-5568-4cd3-82aa-2b63b4874e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/34e7f9d3-c89a-4b82-a12a-d5f7c1232ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/39df7ad4-3ee5-420a-baf2-eeabd004a391_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/657e58ef-b807-4fe4-91e4-66278417d243_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/1fea7321-c290-4f49-98bc-4c7f17f858b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/fde08fd6-8ea2-46b0-874b-79278e65c33e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/8a8fa11e-8c0f-4037-8515-f8fa7fe83180_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/5f343b55-10e9-49cd-a67a-d80dba7bfcd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/b36be9eb-0416-4096-bf43-c254a403ac6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/612b33e7-bb01-432c-aab3-352b2313a6ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/abf16c30-8988-4f98-bad7-64d8a03bc26a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/18-12k 09/19-21k 05/21-26k 07/22-36k', 'remarks': 'vosa@ 21k, 30k, 37k, 50k, 64k, 68k,', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b0b2954e-e6d6-429a-a43d-e9dc0d905471.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117554606, 'registration': 'YP67UAM', 'account': 'ARN185', 'make': 'VOLVO', 'model': 'XC90 DIESEL ESTATE', 'derivative': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic', 'mileage': 68697, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-08-31', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YP67UAM/2025-12-02/image/edf1e32f-43ff-4fc4-a43b-52fa4bde0365_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/767f9a2c-5568-4cd3-82aa-2b63b4874e31_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/34e7f9d3-c89a-4b82-a12a-d5f7c1232ed3_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/39df7ad4-3ee5-420a-baf2-eeabd004a391_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/657e58ef-b807-4fe4-91e4-66278417d243_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/1fea7321-c290-4f49-98bc-4c7f17f858b0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/fde08fd6-8ea2-46b0-874b-79278e65c33e_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/8a8fa11e-8c0f-4037-8515-f8fa7fe83180_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/5f343b55-10e9-49cd-a67a-d80dba7bfcd7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/b36be9eb-0416-4096-bf43-c254a403ac6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/612b33e7-bb01-432c-aab3-352b2313a6ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/YP67UAM/2025-12-02/image/abf16c30-8988-4f98-bad7-64d8a03bc26a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 10/18-12k 09/19-21k 05/21-26k 07/22-36k', 'remarks': 'vosa@ 21k, 30k, 37k, 50k, 64k, 68k,', 'virtual': True, 'seller': 'Arnold Buys Your Car', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/b0b2954e-e6d6-429a-a43d-e9dc0d905471.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fea6fe15-b505-516d-bc49-5f072d6b4b34 with identifier: 117554606
2025-12-04 19:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fea6fe15-b505-516d-bc49-5f072d6b4b34 with scrape type 2
2025-12-04 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fea6fe15-b505-516d-bc49-5f072d6b4b34 with scrape type 2
2025-12-04 19:04:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: fea6fe15-b505-516d-bc49-5f072d6b4b34, identifier: 117554606
2025-12-04 19:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 83bbc862-f0c3-5686-a7ae-d16f7250a18c with identifier: 117407486
2025-12-04 19:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 83bbc862-f0c3-5686-a7ae-d16f7250a18c with identifier: 117407486
2025-12-04 19:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 83bbc862-f0c3-5686-a7ae-d16f7250a18c with identifier: 117407486 to the API
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%2783bbc862-f0c3-5686-a7ae-d16f7250a18c%27 HTTP/1.1" 200 None
2025-12-04 19:04:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 83bbc862-f0c3-5686-a7ae-d16f7250a18c: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117407486?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 128,
 'color': 'YELLOW',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '83bbc862-f0c3-5686-a7ae-d16f7250a18c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'SJ70WZM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117407486',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'PEUGEOT',
 'model': '208 HATCHBACK',
 'odometer': 63971,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-24',
 'seller_name': 'Arnold Clark',
 'title': 'PEUGEOT 208 HATCHBACK 1.2 PureTech 130 GT Line 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.2 PureTech 130 GT Line 5dr EAT8',
 'vin': None,
 'year': 2020}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117407486%27 HTTP/1.1" 200 None
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Saving data for 117407486: {'auction_closing_time': 1764939600.0, 'created_time': 1763751892.183337, 'last_price_update_time': 1764875051.527693}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117407486') HTTP/1.1" 204 0
2025-12-04 19:04:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: fea6fe15-b505-516d-bc49-5f072d6b4b34 with identifier: 117554606
2025-12-04 19:04:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: fea6fe15-b505-516d-bc49-5f072d6b4b34 with identifier: 117554606
2025-12-04 19:04:11 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: fea6fe15-b505-516d-bc49-5f072d6b4b34 with identifier: 117554606 to the API
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27fea6fe15-b505-516d-bc49-5f072d6b4b34%27 HTTP/1.1" 200 None
2025-12-04 19:04:11 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id fea6fe15-b505-516d-bc49-5f072d6b4b34: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:10 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117554606?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'fea6fe15-b505-516d-bc49-5f072d6b4b34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YP67UAM',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117554606',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VOLVO',
 'model': 'XC90 DIESEL ESTATE',
 'odometer': 68697,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-10-30',
 'seller_name': 'Arnold Buys Your Car',
 'title': 'VOLVO XC90 DIESEL ESTATE 2.0 D5 PowerPulse Inscription Pro 5dr AWD '
          'G tronic',
 'transmission': 'automatic',
 'trim': '2.0 D5 PowerPulse Inscription Pro 5dr AWD G tronic',
 'vin': None,
 'year': 2017}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117554606%27 HTTP/1.1" 200 None
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Saving data for 117554606: {'auction_closing_time': 1764939600.0, 'created_time': 1764270279.244898, 'last_price_update_time': 1764875051.812545}
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117554606') HTTP/1.1" 204 0
2025-12-04 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662383?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116872991?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117421105?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662383, 'registration': 'LM18VOU', 'account': 'KCS002', 'make': 'PEUGEOT', 'model': 'TRAVELLER DIESEL ESTATE', 'derivative': '2.0 BlueHDi 150 Allure Standard 5dr', 'mileage': 76190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 9, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/19 8K 10/20 21K 05/21 25K 05/22 33K 10/23 76K (MILEAGE ERROR) 11/24 63K 10/25 74K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcd7148f-9f0a-424b-b24a-cfc04e4ae521.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662383, 'registration': 'LM18VOU', 'account': 'KCS002', 'make': 'PEUGEOT', 'model': 'TRAVELLER DIESEL ESTATE', 'derivative': '2.0 BlueHDi 150 Allure Standard 5dr', 'mileage': 76190, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 9, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-25', 'fuel': 'Diesel', 'motExpiry': '2026-06-03', 'doors': 5, 'engineSize': 1997, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/LM18VOU/2025-12-02/image/330395e3-4c8b-475b-9273-a16080df0a3a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/bf4b9b9d-e080-4d1e-af32-184011b14adb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/cf92d786-4b9d-488c-95ce-3b4525bb52ad_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/3badfd6c-4ee2-47c3-8491-0ebd0a495466_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/c7e0059b-095e-42ff-98be-2932a418f62d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/a8e12838-1fd1-4e37-a66c-3393b69b6c16_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/8c42d6d1-95f6-4c67-b313-62db0833b36b_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/ab181ea5-aa04-49b5-9fb1-c0525ba02149_removebg.jpg?w=600', 'https://abimg003.imgix.net/LM18VOU/2025-12-02/image/090a5132-1f03-443e-96d4-96f401d70feb_removebg.jpg?w=600'], 'colour': 'BROWN', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 07/19 8K 10/20 21K 05/21 25K 05/22 33K 10/23 76K (MILEAGE ERROR) 11/24 63K 10/25 74K', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 139, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dcd7148f-9f0a-424b-b24a-cfc04e4ae521.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-04 19:04:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52669e31-67d3-5cd8-9ca1-4e345de83c70 with scrape type 2
2025-12-04 19:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52669e31-67d3-5cd8-9ca1-4e345de83c70 with scrape type 2
2025-12-04 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 52669e31-67d3-5cd8-9ca1-4e345de83c70, identifier: 117662383
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 116872991, 'registration': 'BW16TOA', 'account': 'KEN008', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Signature Nav 5dr', 'mileage': 48677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BW16TOA/2025-11-04/image/5691f1bd-a6c8-4b3d-b521-aa2f3379b2fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/09e55a75-6f98-4b55-acc3-0d705d17ba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/243d3efb-9900-4092-a743-2ab03f79bc63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/e0438b78-90ae-427d-8d28-7094897a52a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/05064470-15c5-4734-9863-c1091e83ceb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/2d6bd1b0-8830-415d-ac3a-8d91ce849bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/eb70254e-8ccd-4275-b212-6b197fa97f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/847cd4df-db7f-473d-a497-398e723c5d8b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/17- 9k, 07/18- 15k, 06/19- 21k, 07/20- 25k, 08/21- 30k, 03/23- 37k 05/24- 42k, 07/25- 47k', 'remarks': 'vosa@ 21k, 25k, 29k, 34k, 39k, 43k, 47k spare key', 'virtual': True, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93f243b9-0b05-498b-b47d-252c75779c74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 116872991, 'registration': 'BW16TOA', 'account': 'KEN008', 'make': 'RENAULT', 'model': 'KADJAR HATCHBACK', 'derivative': '1.2 TCE Signature Nav 5dr', 'mileage': 48677, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-08-02', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/BW16TOA/2025-11-04/image/5691f1bd-a6c8-4b3d-b521-aa2f3379b2fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/09e55a75-6f98-4b55-acc3-0d705d17ba37_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/243d3efb-9900-4092-a743-2ab03f79bc63_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/e0438b78-90ae-427d-8d28-7094897a52a4_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/05064470-15c5-4734-9863-c1091e83ceb1_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/2d6bd1b0-8830-415d-ac3a-8d91ce849bfc_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/eb70254e-8ccd-4275-b212-6b197fa97f60_removebg.jpg?w=600', 'https://abimg003.imgix.net/BW16TOA/2025-11-04/image/847cd4df-db7f-473d-a497-398e723c5d8b_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book 06/17- 9k, 07/18- 15k, 06/19- 21k, 07/20- 25k, 08/21- 30k, 03/23- 37k 05/24- 42k, 07/25- 47k', 'remarks': 'vosa@ 21k, 25k, 29k, 34k, 39k, 43k, 47k spare key', 'virtual': True, 'seller': 'Ken Jervis Kia', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/93f243b9-0b05-498b-b47d-252c75779c74.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-12-04 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8652913-c531-5e8e-82f7-57af2b0df8ed with scrape type 2
2025-12-04 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8652913-c531-5e8e-82f7-57af2b0df8ed with scrape type 2
2025-12-04 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f8652913-c531-5e8e-82f7-57af2b0df8ed, identifier: 116872991
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117421105, 'registration': 'VX68HWD', 'account': 'ARN017', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': '2.0 D4 R DESIGN 5dr AWD Geartronic', 'mileage': 113547, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-09-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-18', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX68HWD/2025-11-26/image/47bb0ee1-23dd-46dc-8a07-c32e169fd66f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/b6f94d1a-25f2-4c03-b094-df7ba1cc22cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/2ae0580b-e1b9-441c-82c4-12adcb99793c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/ce2bd340-dbf7-436a-8a01-3e901bbfce18_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/35930ed7-62bf-4151-b892-4d640ed32f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/5ac117d6-f660-426b-b101-7f62580cd06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/d196128d-f1ef-4861-8b21-d1f48a7649d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/d078c6a1-030b-4b97-86f5-56a9da94376a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/01d78aeb-18f6-48c9-b9d1-a70be4302afc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/20-54K', 'remarks': 'vosa@ 73k, 80k, 92k, 103k, 111k', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fae5524-e90e-4606-b34a-81ed68fe669a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117421105, 'registration': 'VX68HWD', 'account': 'ARN017', 'make': 'VOLVO', 'model': 'XC60 DIESEL ESTATE', 'derivative': '2.0 D4 R DESIGN 5dr AWD Geartronic', 'mileage': 113547, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': None, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2018-09-11', 'fuel': 'Diesel', 'motExpiry': '2026-08-18', 'doors': 5, 'engineSize': 1969, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/VX68HWD/2025-11-26/image/47bb0ee1-23dd-46dc-8a07-c32e169fd66f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/b6f94d1a-25f2-4c03-b094-df7ba1cc22cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/2ae0580b-e1b9-441c-82c4-12adcb99793c_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/ce2bd340-dbf7-436a-8a01-3e901bbfce18_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/35930ed7-62bf-4151-b892-4d640ed32f9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/5ac117d6-f660-426b-b101-7f62580cd06f_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/d196128d-f1ef-4861-8b21-d1f48a7649d1_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/d078c6a1-030b-4b97-86f5-56a9da94376a_removebg.jpg?w=600', 'https://abimg003.imgix.net/VX68HWD/2025-11-26/image/01d78aeb-18f6-48c9-b9d1-a70be4302afc_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 02/20-54K', 'remarks': 'vosa@ 73k, 80k, 92k, 103k, 111k', 'virtual': True, 'seller': 'Arnold Clark', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 148, 'location': {'siteId': '659779', 'description': 'Aston Barclay Prees Heath'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/0fae5524-e90e-4606-b34a-81ed68fe669a.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a47598-eb3d-56d6-9413-d55d3251a4f8 with identifier: 117421105
2025-12-04 19:04:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a47598-eb3d-56d6-9413-d55d3251a4f8 with scrape type 2
2025-12-04 19:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a47598-eb3d-56d6-9413-d55d3251a4f8 with scrape type 2
2025-12-04 19:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d1a47598-eb3d-56d6-9413-d55d3251a4f8, identifier: 117421105
2025-12-04 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BROWN HTTP/1.1" 200 None
2025-12-04 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 with identifier: 117662383
2025-12-04 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller diesel estate' containing 'traveller'
2025-12-04 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: MAKES_MODELS_NOT_ALLOWED failed for item: 52669e31-67d3-5cd8-9ca1-4e345de83c70 spider: astonbarclay.gb
2025-12-04 19:04:12 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: 52669e31-67d3-5cd8-9ca1-4e345de83c70 due to rule: makes_models_not_allowed.json, error: Rejected due to make 'peugeot' containing 'peugeot' and model 'traveller diesel estate' containing 'traveller'
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'color': 'BROWN',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '52669e31-67d3-5cd8-9ca1-4e345de83c70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'LM18VOU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662383',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'PEUGEOT',
 'model': 'TRAVELLER DIESEL ESTATE',
 'odometer': 76190,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-25',
 'seller_name': 'TCB Group - Prime',
 'title': 'PEUGEOT TRAVELLER DIESEL ESTATE 2.0 BlueHDi 150 Allure Standard 5dr',
 'transmission': 'manual',
 'trim': '2.0 BlueHDi 150 Allure Standard 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662383%27 HTTP/1.1" 200 None
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Saving data for 117662383: {'auction_closing_time': 1764939600.0, 'created_time': 1764702185.183613, 'last_price_update_time': 1764875052.644886}
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662383') HTTP/1.1" 204 0
2025-12-04 19:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-12-04 19:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991
2025-12-04 19:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f8652913-c531-5e8e-82f7-57af2b0df8ed with identifier: 116872991 to the API
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116872991?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f8652913-c531-5e8e-82f7-57af2b0df8ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'BW16TOA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116872991',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'RENAULT',
 'model': 'KADJAR HATCHBACK',
 'odometer': 48677,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-30',
 'seller_name': 'Ken Jervis Kia',
 'title': 'RENAULT KADJAR HATCHBACK 1.2 TCE Signature Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 TCE Signature Nav 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116872991%27 HTTP/1.1" 200 None
2025-12-04 19:04:12 [astonbarclay.gb] INFO: Saving data for 116872991: {'auction_closing_time': 1764939600.0, 'created_time': 1763492943.189844, 'last_price_update_time': 1764875052.99733}
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116872991') HTTP/1.1" 204 0
2025-12-04 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d1a47598-eb3d-56d6-9413-d55d3251a4f8 with identifier: 117421105
2025-12-04 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d1a47598-eb3d-56d6-9413-d55d3251a4f8 with identifier: 117421105
2025-12-04 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 182735 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182735
2025-12-04 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d1a47598-eb3d-56d6-9413-d55d3251a4f8 spider: astonbarclay.gb
2025-12-04 19:04:13 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d1a47598-eb3d-56d6-9413-d55d3251a4f8 due to rule: high_mileage_for_country.json, error: 182735 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    182735
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd1a47598-eb3d-56d6-9413-d55d3251a4f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'VX68HWD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117421105',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VOLVO',
 'model': 'XC60 DIESEL ESTATE',
 'odometer': 113547,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-11',
 'seller_name': 'Arnold Clark',
 'title': 'VOLVO XC60 DIESEL ESTATE 2.0 D4 R DESIGN 5dr AWD Geartronic',
 'transmission': 'automatic',
 'trim': '2.0 D4 R DESIGN 5dr AWD Geartronic',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117421105%27 HTTP/1.1" 200 None
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Saving data for 117421105: {'auction_closing_time': 1764939600.0, 'created_time': 1763751816.294085, 'last_price_update_time': 1764875053.216543}
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117421105') HTTP/1.1" 204 0
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 10, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117288542, 'registration': 'KR69FEF', 'account': 'KCS002', 'make': 'DS', 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)', 'derivative': '1.5 BlueHDi Prestige 5dr', 'mileage': 59307, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 10, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-30', 'fuel': 'Diesel', 'motExpiry': '2026-03-06', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KR69FEF/2025-11-18/image/5fc3ff04-f398-4285-b5fb-bb5c2828a406_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/82526bb9-5bd4-4632-984f-5c401d7d0c88_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/00fe4a7f-54dc-4dda-a46e-8b7dc271ce0f_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/64807544-65c0-4bc0-ae42-79ef9ab4cf36_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c3bab845-d629-41a8-87a5-71e5c3165e0c_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c9238d51-bd82-4b49-98f7-545d4cd1ce9d_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/38495995-9694-49c1-b88e-75d619664455_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/c2eae0d7-6b92-4b00-b9c3-22a4af31d163_removebg.jpg?w=600', 'https://abimg003.imgix.net/KR69FEF/2025-11-18/image/0b5ce54f-8971-415d-90c9-b914ea23dd0f_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 05/21 8K 12/24 50K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 97, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/705f02f4-e35e-4a5e-ba1b-49c0b0a6b704.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-04 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-12-04 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 306f4428-c66b-5c17-b51a-aa7299ec0e4f with scrape type 2
2025-12-04 19:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 306f4428-c66b-5c17-b51a-aa7299ec0e4f, identifier: 117288542
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 8, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024353, 'registration': 'KJ18UDH', 'account': 'KCS002', 'make': 'MINI', 'model': 'HATCHBACK', 'derivative': '1.5 Cooper II 5dr', 'mileage': 55760, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 8, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-10-07', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/bb33165b-5d3c-42e7-81e3-aa7932d495b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/f766b7b4-f6b3-427b-91f2-db043f15342e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2d7f92d9-aa3e-4440-aae7-b066cf5594a3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/86e2a420-d758-4d1f-a2f4-2860b86cc1d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/82ac0aed-a8db-4fa9-a6fe-76030140c08e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b7d3b398-75f4-4fdf-8770-48be014880c2_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/420351c1-9807-44dd-8306-c89f7a672acc_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/2f9b0f0e-dd90-452e-a73b-80d042ddd820_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/b6948e82-efa9-423d-a88c-ab71d127f9c9_removebg.jpg?w=600', 'https://abimg003.imgix.net/KJ18UDH/2025-11-07/image/c61f4a2e-0fff-4ab5-9b6c-aa7e81a1b58b_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service digital IDRIVE 04/21 15K', 'remarks': 'NO SPARE KEY', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 116, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/d845f5a5-bdbe-4ad5-9c24-1342ba997053.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-04 19:04:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-12-04 19:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with scrape type 2
2025-12-04 19:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9502caad-ffbb-55ee-8b5d-4a3906815fe5, identifier: 117024353
2025-12-04 19:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-04 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542
2025-12-04 19:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 306f4428-c66b-5c17-b51a-aa7299ec0e4f with identifier: 117288542 to the API
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27306f4428-c66b-5c17-b51a-aa7299ec0e4f%27 HTTP/1.1" 200 None
2025-12-04 19:04:13 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 306f4428-c66b-5c17-b51a-aa7299ec0e4f: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:12 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117288542?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 97,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '306f4428-c66b-5c17-b51a-aa7299ec0e4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KR69FEF',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117288542',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'DS',
 'model': 'DS 3 DIESEL CROSSBACK HATCHBACK (RC)',
 'odometer': 59307,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'DS DS 3 DIESEL CROSSBACK HATCHBACK (RC) 1.5 BlueHDi Prestige 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Prestige 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117288542%27 HTTP/1.1" 200 None
2025-12-04 19:04:13 [astonbarclay.gb] INFO: Saving data for 117288542: {'auction_closing_time': 1764939600.0, 'created_time': 1763456461.330598, 'last_price_update_time': 1764875053.951188}
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117288542') HTTP/1.1" 204 0
2025-12-04 19:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-04 19:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353
2025-12-04 19:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9502caad-ffbb-55ee-8b5d-4a3906815fe5 with identifier: 117024353 to the API
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279502caad-ffbb-55ee-8b5d-4a3906815fe5%27 HTTP/1.1" 200 None
2025-12-04 19:04:14 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9502caad-ffbb-55ee-8b5d-4a3906815fe5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:13 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024353?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 116,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9502caad-ffbb-55ee-8b5d-4a3906815fe5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KJ18UDH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024353',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'MINI',
 'model': 'HATCHBACK',
 'odometer': 55760,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'MINI HATCHBACK 1.5 Cooper II 5dr',
 'transmission': 'manual',
 'trim': '1.5 Cooper II 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024353%27 HTTP/1.1" 200 None
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Saving data for 117024353: {'auction_closing_time': 1764939600.0, 'created_time': 1762455731.028291, 'last_price_update_time': 1764875054.274543}
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024353') HTTP/1.1" 204 0
2025-12-04 19:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117662079, 'registration': 'DS18MMO', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 60294, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 12, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/19 7K 04/20 13K 01/21 18K 11/21 28K 06/22 40K 07/25 59K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f29362d2-c7d2-4366-a45d-1ee14972c400.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117662079, 'registration': 'DS18MMO', 'account': 'KCS002', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.2 DiG-T Tekna 5dr', 'mileage': 60294, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 12, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-07-16', 'doors': 5, 'engineSize': 1197, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/DS18MMO/2025-12-02/image/326395ca-a6ec-4001-893d-21e0f0907202_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/3f4f2b49-3ec9-4eda-b368-157b402a9d03_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/6a82ce94-55c1-40cd-86aa-02c1e9d4e2a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/92a974d9-f0db-4f98-8ef3-d9c65aae54e4_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/eb0f444d-5ccd-4174-b751-310d29957c4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/e48f57b9-748d-41a0-a19b-370f89bf0efd_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/2abcfa8c-7f6c-4501-95ef-b2ac19257873_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/5c6f1c4e-1378-46c6-85d5-a622a28748e7_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/12ddd530-3d88-4642-ae11-10cc4829c874_removebg.jpg?w=600', 'https://abimg003.imgix.net/DS18MMO/2025-12-02/image/f9e664e9-18f3-422b-b182-c43ae6c37176_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service book 02/19 7K 04/20 13K 01/21 18K 11/21 28K 06/22 40K 07/25 59K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 129, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f29362d2-c7d2-4366-a45d-1ee14972c400.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-04 19:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67123457-1c0a-5cdd-8be3-eb490de642b0 with scrape type 2
2025-12-04 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67123457-1c0a-5cdd-8be3-eb490de642b0 with scrape type 2
2025-12-04 19:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 67123457-1c0a-5cdd-8be3-eb490de642b0, identifier: 117662079
2025-12-04 19:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-04 19:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079
2025-12-04 19:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 67123457-1c0a-5cdd-8be3-eb490de642b0 with identifier: 117662079 to the API
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117662079?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '67123457-1c0a-5cdd-8be3-eb490de642b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'DS18MMO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117662079',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 60294,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'NISSAN QASHQAI HATCHBACK 1.2 DiG-T Tekna 5dr',
 'transmission': 'manual',
 'trim': '1.2 DiG-T Tekna 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117662079%27 HTTP/1.1" 200 None
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Saving data for 117662079: {'auction_closing_time': 1764939600.0, 'created_time': 1764702173.909431, 'last_price_update_time': 1764875054.723948}
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117662079') HTTP/1.1" 204 0
2025-12-04 19:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 7, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:14 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117024058, 'registration': 'MR51ZUK', 'account': 'KCS002', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo SE 5dr', 'mileage': 66518, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 7, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-06-30', 'fuel': 'Petrol', 'motExpiry': '2026-02-11', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/0fbc2b6f-d2e4-4b71-9af0-a95b82da3901_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b59f2b05-b1f0-4bac-8c0e-79908fd0e8a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/3d524d08-0902-4518-964e-0ffe909069f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/b62b162d-1959-4d54-a32e-1a4c25d7ad06_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/87467e67-a3d5-4dd0-a818-0dfed2579e1c_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/526ae119-922c-45a2-a923-ff39b2a1e23b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/96a5fc3c-84e0-45d5-b7f1-1130235f8667_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/069f69a2-c22d-499d-9dd5-e33f5b5cb56f_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/501e76e6-43fe-4f39-8438-9d707d92d7a1_removebg.jpg?w=600', 'https://abimg003.imgix.net/MR51ZUK/2025-11-10/image/a5a01529-354b-4299-ba28-a47203256140_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY - *Plate May Not Remain with Vehicle*', 'virtual': True, 'seller': 'TCB Group - Prime', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '2', 'v5': True, 'v5details': 'Here', 'co2': 117, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e2cb7ebd-2729-41c9-8b34-ee3baed84e60.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-04 19:04:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-12-04 19:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 9655b4b9-2675-58ef-a11e-03b69ddaeff4, identifier: 117024058
2025-12-04 19:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-04 19:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058
2025-12-04 19:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 9655b4b9-2675-58ef-a11e-03b69ddaeff4 with identifier: 117024058 to the API
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%279655b4b9-2675-58ef-a11e-03b69ddaeff4%27 HTTP/1.1" 200 None
2025-12-04 19:04:15 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 9655b4b9-2675-58ef-a11e-03b69ddaeff4: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:14 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117024058?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 117,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '9655b4b9-2675-58ef-a11e-03b69ddaeff4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MR51ZUK',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117024058',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 66518,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-30',
 'seller_name': 'TCB Group - Prime',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo SE 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo SE 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117024058%27 HTTP/1.1" 200 None
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Saving data for 117024058: {'auction_closing_time': 1764939600.0, 'created_time': 1762455702.144844, 'last_price_update_time': 1764875055.321004}
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117024058') HTTP/1.1" 204 0
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117131446?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117507998, 'registration': 'WF69LTY', 'account': 'WIL004', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 69830, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 2, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-14', 'fuel': 'Diesel', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 06/25 59K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bd67746-5097-4c71-b047-951dc1e77cbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117507998, 'registration': 'WF69LTY', 'account': 'WIL004', 'make': 'PEUGEOT', 'model': '5008 DIESEL ESTATE', 'derivative': '1.5 BlueHDi Allure 5dr', 'mileage': 69830, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 2, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-10-14', 'fuel': 'Diesel', 'motExpiry': '2025-12-13', 'doors': 5, 'engineSize': 1500, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/WF69LTY/2025-12-02/image/ebba9d94-d048-40ae-ae2c-02dce2f59879_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/d7816e03-49d0-4507-be86-3cb520c3a2ea_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/c82a6c11-57dd-4ca7-9bbb-da86b4c3152c_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e1cd49a7-747a-4449-8f7c-63d3e07418ab_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/29e5e650-0a5f-4881-b0e8-6b7a04b100f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/6701d40e-48f2-4334-96fe-482f81e13cae_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/0af3fb97-8ce3-45e0-9184-c553b71405e5_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/e468d304-4f9f-4ca5-b567-be5d4744ca49_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/56dc19a4-1203-4f50-8f6e-f66647fcd2f2_removebg.jpg?w=600', 'https://abimg003.imgix.net/WF69LTY/2025-12-02/image/37378945-9be0-4147-b384-ab49c666020a_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 06/25 59K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '3', 'v5': True, 'v5details': 'Here', 'co2': 107, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/6bd67746-5097-4c71-b047-951dc1e77cbc.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-04 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fe52d45-63a2-53ab-8319-e0b8532403ce with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fe52d45-63a2-53ab-8319-e0b8532403ce with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4fe52d45-63a2-53ab-8319-e0b8532403ce, identifier: 117507998
2025-12-04 19:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-04 19:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998
2025-12-04 19:04:15 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4fe52d45-63a2-53ab-8319-e0b8532403ce with identifier: 117507998 to the API
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117507998?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 107,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': '4fe52d45-63a2-53ab-8319-e0b8532403ce',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'WF69LTY',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117507998',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'PEUGEOT',
 'model': '5008 DIESEL ESTATE',
 'odometer': 69830,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': 'Wilsons',
 'title': 'PEUGEOT 5008 DIESEL ESTATE 1.5 BlueHDi Allure 5dr',
 'transmission': 'manual',
 'trim': '1.5 BlueHDi Allure 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117507998%27 HTTP/1.1" 200 None
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Saving data for 117507998: {'auction_closing_time': 1764939600.0, 'created_time': 1764702133.483649, 'last_price_update_time': 1764875055.833534}
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117507998') HTTP/1.1" 204 0
2025-12-04 19:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115951284?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117660087, 'registration': 'FD70MVG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr', 'mileage': 47042, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/21 21K 12/22 29K 10/23 41K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baa24e13-7ddf-4094-85d7-00ae2a9c15aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117660087, 'registration': 'FD70MVG', 'account': 'WIL004', 'make': 'VAUXHALL', 'model': 'GRANDLAND X HATCHBACK', 'derivative': '1.2 Turbo Elite Nav 5dr', 'mileage': 47042, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 3, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2020-11-30', 'fuel': 'Petrol', 'motExpiry': '2026-01-16', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bb1c5b0f-28e4-4167-8682-387669bca078_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/9435d6c4-f83f-423a-a9d1-119f4e90fe34_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/bd5ef7b2-716d-4667-9330-ff01f0f81392_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d7dd04b8-e937-4f63-af3a-b8d4afb935f7_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/5ab5850a-ccf1-48f3-a062-44ef4c5aee28_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/3e87a060-d349-4347-a6d8-ea109f0da041_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/d94def93-7122-496c-a693-700a24ed74e8_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/a5de513b-34a4-4f72-8f27-c42680adb6d0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/55b525a7-1d87-475a-a34c-015eb1c9d665_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/c3c852dc-35a4-491b-8c87-be61d14fe8fe_removebg.jpg?w=600', 'https://abimg003.imgix.net/FD70MVG/2025-12-02/image/95fcc619-4c1a-4f66-a40f-1108cb5b2a3a_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 11/21 21K 12/22 29K 10/23 41K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 142, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/baa24e13-7ddf-4094-85d7-00ae2a9c15aa.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-04 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: ad9b9b48-76f8-59ad-9d41-c83d882f26a4, identifier: 117660087
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 5, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117243071, 'registration': 'PN19TFE', 'account': 'WIL004', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.3 DiG-T 160 N-Connecta 5dr', 'mileage': 46730, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 5, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2019-06-28', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PN19TFE/2025-11-19/image/ff6a533c-7a71-41fc-a82a-f02229dfaddf_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/e8775db4-a7c5-4e66-b9cb-7ea943022429_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/f0273086-c915-41cc-af57-e26f783878af_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/15202e68-a80b-4e6a-aa45-ae09e1a304ae_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/18f7690b-0781-475b-86c7-58076effbe93_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/d51971c3-8376-4813-9f0f-2782a1f4ee6f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/be766b33-81f0-4df4-9188-ae11aac650fc_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/bd8568bc-35b1-4154-9820-da18eb307293_removebg.jpg?w=600', 'https://abimg003.imgix.net/PN19TFE/2025-11-19/image/a34457d6-9af4-41e4-9726-0f756279b9e4_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service invoice 10/22 25K 08/23 30K 08/24 38K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/13710208-7bbc-4fca-8548-3fa49b124abd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-04 19:04:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-12-04 19:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with scrape type 2
2025-12-04 19:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5, identifier: 117243071
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131404, 'registration': 'GY17CRX', 'account': 'WIL004', 'make': 'LAND ROVER', 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK', 'derivative': '2.0 TD4 SE Tech 5dr Auto', 'mileage': 48702, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 6, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2017-04-24', 'fuel': 'Diesel', 'motExpiry': '2026-10-23', 'doors': 5, 'engineSize': 1999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c250211a-7e59-46ae-b9f7-9821ba2ce6c8_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/c195c5b0-711e-4c98-ac15-d02ba041a89a_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/b52d7545-f7f4-459d-bfe7-14c96feeed6c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/5832d238-845c-444c-b980-de05cbd3db2e_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/a25139dc-6fe3-46ff-a548-b1e3ff85ab8c_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/8709b038-5e9e-4be7-bc8b-802d263519dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/6192412d-cd19-4519-b2e8-d23881c4b825_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/627df8ca-6eab-4d23-8977-65defd8c6abb_removebg.jpg?w=600', 'https://abimg003.imgix.net/GY17CRX/2025-11-17/image/2d518c96-d513-45b4-a0ac-73772c7f8fd0_removebg.jpg?w=600'], 'colour': 'BLACK', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print 04/19 12K 03/21 27K', 'remarks': 'S/KEY SD', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 134, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/8648b8e4-a601-49da-9cf8-c772842242fe.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-04 19:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-12-04 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8cb08f6-7578-50ce-b7bb-eea640cf2775 with scrape type 2
2025-12-04 19:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d8cb08f6-7578-50ce-b7bb-eea640cf2775, identifier: 117131404
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117131446, 'registration': 'MV20KJO', 'account': 'WIL004', 'make': 'TESLA', 'model': 'MODEL 3 SALOON', 'derivative': 'Performance AWD 4dr [Performance Upgrade] Auto', 'mileage': 95232, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 4, 'hall': 'Main Hall', 'transmission': 'automatic', 'firstRegistration': '2020-03-07', 'fuel': 'Electric', 'motExpiry': '2026-09-11', 'doors': 4, 'engineSize': None, 'bodyType': 'Saloon', 'images': ['https://abimg003.imgix.net/MV20KJO/2025-11-17/image/b102b27e-6f98-4242-a1e9-2f2908dcb728_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/faa48bbf-32e3-46cd-9f96-27cf2273a2c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/7406a0ad-e4b0-4b86-9cd3-76c24ba64801_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/db2f2ab1-e95f-4f2d-97d8-18efa2349584_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/43ffac0c-09a6-479b-8065-79b269a9f2f3_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/743407a9-8c79-4f68-9a86-9649c0dbe0e6_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/77576649-d0d5-457c-b82b-2ae6e60cfd5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/3cc0635e-e764-4a90-81de-f3c485d5ed5b_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c12ca258-c37c-45ed-b365-a6226078d822_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/c6414832-9f50-40b7-9be9-8a03befd5057_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/99dfce62-0286-4635-b86e-094324d935fa_removebg.jpg?w=600', 'https://abimg003.imgix.net/MV20KJO/2025-11-17/image/ffe248b1-e140-46fe-8fa1-e35a320b63df_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': '', 'remarks': 'S/KEY', 'virtual': True, 'seller': 'Wilsons', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': None, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/dc16c717-2d19-4b17-8b97-00dfc5a80826.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-04 19:04:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-12-04 19:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with scrape type 2
2025-12-04 19:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d6a0a924-e876-5ad9-84ea-9e09cfa9c039, identifier: 117131446
2025-12-04 19:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-04 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087
2025-12-04 19:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: ad9b9b48-76f8-59ad-9d41-c83d882f26a4 with identifier: 117660087 to the API
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117660087?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 142,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'ad9b9b48-76f8-59ad-9d41-c83d882f26a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'FD70MVG',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117660087',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'GRANDLAND X HATCHBACK',
 'odometer': 47042,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-30',
 'seller_name': 'Wilsons',
 'title': 'VAUXHALL GRANDLAND X HATCHBACK 1.2 Turbo Elite Nav 5dr',
 'transmission': 'manual',
 'trim': '1.2 Turbo Elite Nav 5dr',
 'vin': None,
 'year': 2020}
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117660087%27 HTTP/1.1" 200 None
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Saving data for 117660087: {'auction_closing_time': 1764939600.0, 'created_time': 1764702149.709235, 'last_price_update_time': 1764875056.576271}
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117660087') HTTP/1.1" 204 0
2025-12-04 19:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-04 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071
2025-12-04 19:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5 with identifier: 117243071 to the API
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5%27 HTTP/1.1" 200 None
2025-12-04 19:04:16 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:15 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117243071?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f08ec7c8-7cf2-5835-87a4-5ca0ba2d0ba5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PN19TFE',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117243071',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 46730,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-28',
 'seller_name': 'Wilsons',
 'title': 'NISSAN QASHQAI HATCHBACK 1.3 DiG-T 160 N-Connecta 5dr',
 'transmission': 'manual',
 'trim': '1.3 DiG-T 160 N-Connecta 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117243071%27 HTTP/1.1" 200 None
2025-12-04 19:04:16 [astonbarclay.gb] INFO: Saving data for 117243071: {'auction_closing_time': 1764939600.0, 'created_time': 1763492786.433532, 'last_price_update_time': 1764875056.86897}
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117243071') HTTP/1.1" 204 0
2025-12-04 19:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-04 19:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404
2025-12-04 19:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d8cb08f6-7578-50ce-b7bb-eea640cf2775 with identifier: 117131404 to the API
2025-12-04 19:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27d8cb08f6-7578-50ce-b7bb-eea640cf2775%27 HTTP/1.1" 200 None
2025-12-04 19:04:17 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id d8cb08f6-7578-50ce-b7bb-eea640cf2775: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:16 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117131404?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 134,
 'color': 'BLACK',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Diesel',
 'id': 'd8cb08f6-7578-50ce-b7bb-eea640cf2775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'GY17CRX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131404',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'LAND ROVER',
 'model': 'RANGE ROVER EVOQUE DIESEL HATCHBACK',
 'odometer': 48702,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-04-24',
 'seller_name': 'Wilsons',
 'title': 'LAND ROVER RANGE ROVER EVOQUE DIESEL HATCHBACK 2.0 TD4 SE Tech 5dr '
          'Auto',
 'transmission': 'automatic',
 'trim': '2.0 TD4 SE Tech 5dr Auto',
 'vin': None,
 'year': 2017}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131404%27 HTTP/1.1" 200 None
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Saving data for 117131404: {'auction_closing_time': 1764939600.0, 'created_time': 1763060555.156275, 'last_price_update_time': 1764875057.164371}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131404') HTTP/1.1" 204 0
2025-12-04 19:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-04 19:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 with identifier: 117131446
2025-12-04 19:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Validation error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
2025-12-04 19:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: rule_title: HIGH_MILEAGE_FOR_COUNTRY failed for item: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 spider: astonbarclay.gb
2025-12-04 19:04:17 [scrapy.core.scraper] INFO: Dropped: Spider: astonbarclay.gb, Dropping listing: d6a0a924-e876-5ad9-84ea-9e09cfa9c039 due to rule: high_mileage_for_country.json, error: 153260 is greater than the maximum of 150000

Failed validating 'maximum' in schema['allOf'][0]['then']['properties']['odometer_in_km']:
    {'maximum': 150000, 'type': 'integer'}

On instance['odometer_in_km']:
    153260
{'auction_title': '',
 'c_o_2_emission_value': None,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Electric',
 'id': 'd6a0a924-e876-5ad9-84ea-9e09cfa9c039',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'MV20KJO',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117131446',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'TESLA',
 'model': 'MODEL 3 SALOON',
 'odometer': 95232,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-07',
 'seller_name': 'Wilsons',
 'title': 'TESLA MODEL 3 SALOON Performance AWD 4dr [Performance Upgrade] Auto',
 'transmission': 'automatic',
 'trim': 'Performance AWD 4dr [Performance Upgrade] Auto',
 'vin': None,
 'year': 2020}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117131446%27 HTTP/1.1" 200 None
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Saving data for 117131446: {'auction_closing_time': 1764939600.0, 'created_time': 1763060550.303965, 'last_price_update_time': 1764875057.377489}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117131446') HTTP/1.1" 204 0
2025-12-04 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115951329?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117121214?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115951284, 'registration': 'LA19XHZ', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 59387, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/d7c63fa6-112b-4cc5-9475-dc9ceae54b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/e6ce5b3f-c712-4a1a-9b09-1b49f1b31572_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/b4cf8c8a-ddab-4104-83ab-b8d34b051d0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/178364de-07c2-46f2-8f2d-e924bcaf6be1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/3931486a-d808-4da5-b39d-8b17c7887771_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/27f0f099-7298-4d5e-8489-dfdefcebda83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/2aa9ac1b-8bc6-4e15-b224-347a780a10cb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 15K- 26K- 39K - 54K-  SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be54ddd5-ea3d-475c-beaf-88a7c79e68c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115951284, 'registration': 'LA19XHZ', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 59387, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/d7c63fa6-112b-4cc5-9475-dc9ceae54b12_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/e6ce5b3f-c712-4a1a-9b09-1b49f1b31572_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/b4cf8c8a-ddab-4104-83ab-b8d34b051d0e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/178364de-07c2-46f2-8f2d-e924bcaf6be1_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/3931486a-d808-4da5-b39d-8b17c7887771_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/27f0f099-7298-4d5e-8489-dfdefcebda83_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XHZ/2025-10-09/image/2aa9ac1b-8bc6-4e15-b224-347a780a10cb_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'VOSA STATES 15K- 26K- 39K - 54K-  SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/be54ddd5-ea3d-475c-beaf-88a7c79e68c1.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33253d44-8dc5-5879-be05-08103f6dbef0 with identifier: 115951284
2025-12-04 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 33253d44-8dc5-5879-be05-08103f6dbef0 with scrape type 2
2025-12-04 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 33253d44-8dc5-5879-be05-08103f6dbef0 with scrape type 2
2025-12-04 19:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 33253d44-8dc5-5879-be05-08103f6dbef0, identifier: 115951284
2025-12-04 19:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 33253d44-8dc5-5879-be05-08103f6dbef0 with identifier: 115951284
2025-12-04 19:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 33253d44-8dc5-5879-be05-08103f6dbef0 with identifier: 115951284
2025-12-04 19:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 33253d44-8dc5-5879-be05-08103f6dbef0 with identifier: 115951284 to the API
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115951284?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': '33253d44-8dc5-5879-be05-08103f6dbef0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LA19XHZ',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115951284',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 59387,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'AAM Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 83 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951284%27 HTTP/1.1" 200 None
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Saving data for 115951284: {'auction_closing_time': 1764936000.0, 'created_time': 1764406997.308589, 'last_price_update_time': 1764875057.801093}
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115951284') HTTP/1.1" 204 0
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115951329, 'registration': 'LA19XPD', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 71938, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XPD/2025-10-09/image/40e243f3-ade5-4b62-8baa-62647ba8b603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/33bcf7a5-db45-4dd4-8ba1-54c6bf0c8918_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/b73a0c53-9aac-4a57-9fe1-ea26359b65cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/1d6585a2-0ce8-4531-86ef-114b4352d70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/7e7241b9-42f1-4360-8524-56a1f6f849b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/93809dcf-c5a4-4071-98dc-3d6d3bad717f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/e112d2da-ef04-4145-a176-c90cdf2113c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/500945f8-bb03-4149-a8d3-5ced57c2d57a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/33b92f20-976b-48a2-a115-9b7197ae9708_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 19K - 37K - 54K- 65K - SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59fffd43-7421-43a6-866f-5962e0c58903.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115951329, 'registration': 'LA19XPD', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 71938, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-15', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XPD/2025-10-09/image/40e243f3-ade5-4b62-8baa-62647ba8b603_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/33bcf7a5-db45-4dd4-8ba1-54c6bf0c8918_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/b73a0c53-9aac-4a57-9fe1-ea26359b65cb_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/1d6585a2-0ce8-4531-86ef-114b4352d70f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/7e7241b9-42f1-4360-8524-56a1f6f849b3_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/93809dcf-c5a4-4071-98dc-3d6d3bad717f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/e112d2da-ef04-4145-a176-c90cdf2113c4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/500945f8-bb03-4149-a8d3-5ced57c2d57a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XPD/2025-10-09/image/33b92f20-976b-48a2-a115-9b7197ae9708_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN VOSA STATES 19K - 37K - 54K- 65K - SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/59fffd43-7421-43a6-866f-5962e0c58903.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f23b72c4-8e05-586e-8e35-d0038e0a2010 with identifier: 115951329
2025-12-04 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f23b72c4-8e05-586e-8e35-d0038e0a2010 with scrape type 2
2025-12-04 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f23b72c4-8e05-586e-8e35-d0038e0a2010 with scrape type 2
2025-12-04 19:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: f23b72c4-8e05-586e-8e35-d0038e0a2010, identifier: 115951329
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117121214, 'registration': 'AV18ODA', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SE 5dr', 'mileage': 74568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 1, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-02', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0f51b97-a81f-4d9e-a642-6f24ee007b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/6336eef9-deae-4221-bcfa-5f16e7e89d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/0b2ab386-9169-49f6-bc58-ad8b4fc27b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/2649305c-4cc3-4ebf-aa5a-e4e7e779fb94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/852b5b71-4b00-4dc7-b9df-2063654efe8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/72b6a836-b28d-4536-8472-97a25fcb6551_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/129f2d66-c37d-4801-8322-2c099f660da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b5fd96f7-1cb0-4407-ac11-f0f50a113fa4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/21 18K 02/25 59K / INV 12/20 14K 11/22 24K 02/24 41K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b2e06b5-6b67-4e33-a793-0c71467d9359.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:17 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117121214, 'registration': 'AV18ODA', 'account': 'MOT075', 'make': 'VOLKSWAGEN', 'model': 'T-ROC HATCHBACK', 'derivative': '1.5 TSI EVO SE 5dr', 'mileage': 74568, 'mileageWarranty': True, 'type': 'car', 'saleId': 17961, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T13:00Z', 'lot': 1, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2018-05-02', 'fuel': 'Petrol', 'motExpiry': '2026-05-01', 'doors': 5, 'engineSize': 1498, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0701752-17d0-4bc1-9788-9e0a68c38bc3_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b0f51b97-a81f-4d9e-a642-6f24ee007b7d_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/6336eef9-deae-4221-bcfa-5f16e7e89d86_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/0b2ab386-9169-49f6-bc58-ad8b4fc27b41_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/2649305c-4cc3-4ebf-aa5a-e4e7e779fb94_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/852b5b71-4b00-4dc7-b9df-2063654efe8b_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/72b6a836-b28d-4536-8472-97a25fcb6551_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/129f2d66-c37d-4801-8322-2c099f660da8_removebg.jpg?w=600', 'https://abimg003.imgix.net/AV18ODA/2025-11-11/image/b5fd96f7-1cb0-4407-ac11-f0f50a113fa4_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Fleet', 'serviceHistory': 'Service print and book SP 11/21 18K 02/25 59K / INV 12/20 14K 11/22 24K 02/24 41K', 'remarks': 'SKEY', 'virtual': True, 'seller': 'MotoNovo Finance', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 121, 'location': {'siteId': '659780', 'description': 'Aston Barclay Westbury'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/2b2e06b5-6b67-4e33-a793-0c71467d9359.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-12-04 19:04:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 78b2dd90-e09f-5942-b237-c795adb5ae40 with scrape type 2
2025-12-04 19:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 78b2dd90-e09f-5942-b237-c795adb5ae40 with scrape type 2
2025-12-04 19:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 78b2dd90-e09f-5942-b237-c795adb5ae40, identifier: 117121214
2025-12-04 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: f23b72c4-8e05-586e-8e35-d0038e0a2010 with identifier: 115951329
2025-12-04 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: f23b72c4-8e05-586e-8e35-d0038e0a2010 with identifier: 115951329
2025-12-04 19:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: f23b72c4-8e05-586e-8e35-d0038e0a2010 with identifier: 115951329 to the API
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115951329?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'f23b72c4-8e05-586e-8e35-d0038e0a2010',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LA19XPD',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115951329',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 71938,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'AAM Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 83 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951329%27 HTTP/1.1" 200 None
2025-12-04 19:04:18 [astonbarclay.gb] INFO: Saving data for 115951329: {'auction_closing_time': 1764936000.0, 'created_time': 1764406994.988054, 'last_price_update_time': 1764875058.280002}
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115951329') HTTP/1.1" 204 0
2025-12-04 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-12-04 19:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214
2025-12-04 19:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 78b2dd90-e09f-5942-b237-c795adb5ae40 with identifier: 117121214 to the API
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117121214?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T13:00:00Z',
 'fuel_type': 'Petrol',
 'id': '78b2dd90-e09f-5942-b237-c795adb5ae40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'AV18ODA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117121214',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VOLKSWAGEN',
 'model': 'T-ROC HATCHBACK',
 'odometer': 74568,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-02',
 'seller_name': 'MotoNovo Finance',
 'title': 'VOLKSWAGEN T-ROC HATCHBACK 1.5 TSI EVO SE 5dr',
 'transmission': 'manual',
 'trim': '1.5 TSI EVO SE 5dr',
 'vin': None,
 'year': 2018}
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117121214%27 HTTP/1.1" 200 None
2025-12-04 19:04:18 [astonbarclay.gb] INFO: Saving data for 117121214: {'auction_closing_time': 1764939600.0, 'created_time': 1762887652.428682, 'last_price_update_time': 1764875058.638969}
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117121214') HTTP/1.1" 204 0
2025-12-04 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/116163300?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117742183?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117539707?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115951209?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2025-12-04 19:04:18 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 116163300, 'registration': 'LB19GHN', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 69209, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB19GHN/2025-10-09/image/7ec879d7-1d2a-4174-abcd-d35ba6d0ae57_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/853ccbe9-4e78-49bf-a07c-4ea82af54c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/bf0c5122-2d8f-4d14-8176-103d9a5cb4a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/cdf42a5b-4271-4fbc-b953-0ac454cd6b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/f8cfbea9-8dc5-4f42-be33-897886f2fdde_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/bb9a9166-d8ed-4da4-aa0a-522b5eb2876e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/50956d07-56e8-4b67-8e30-c575eb63ec5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/c1c3efe5-cd97-4ea6-b6ad-4c0f26bcaa03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/a85b6b1b-2c98-4c21-a20d-2e73d5bce5ab_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 25K - 36K -51K  - 66K-', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 118, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3b3a6a1-b39c-4f54-8f05-3d9df094318d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:18 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 116163300, 'registration': 'LB19GHN', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 AIRCROSS HATCHBACK', 'derivative': '1.2 PureTech Flair 5dr', 'mileage': 69209, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-04-30', 'fuel': 'Petrol', 'motExpiry': '2026-05-25', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LB19GHN/2025-10-09/image/7ec879d7-1d2a-4174-abcd-d35ba6d0ae57_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/853ccbe9-4e78-49bf-a07c-4ea82af54c4d_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/bf0c5122-2d8f-4d14-8176-103d9a5cb4a8_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/cdf42a5b-4271-4fbc-b953-0ac454cd6b17_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/f8cfbea9-8dc5-4f42-be33-897886f2fdde_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/bb9a9166-d8ed-4da4-aa0a-522b5eb2876e_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/50956d07-56e8-4b67-8e30-c575eb63ec5c_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/c1c3efe5-cd97-4ea6-b6ad-4c0f26bcaa03_removebg.jpg?w=600', 'https://abimg003.imgix.net/LB19GHN/2025-10-09/image/a85b6b1b-2c98-4c21-a20d-2e73d5bce5ab_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'EMPTY SERVICE BOOK', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 25K - 36K -51K  - 66K-', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 118, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/f3b3a6a1-b39c-4f54-8f05-3d9df094318d.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with identifier: 116163300
2025-12-04 19:04:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with scrape type 2
2025-12-04 19:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with scrape type 2
2025-12-04 19:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: c79da8ac-2ee5-5b57-9c00-23bcd451d3fd, identifier: 116163300
2025-12-04 19:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with identifier: 116163300
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:04:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=BEIGE HTTP/1.1" 200 None
2025-12-04 19:04:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with identifier: 116163300
2025-12-04 19:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: c79da8ac-2ee5-5b57-9c00-23bcd451d3fd with identifier: 116163300 to the API
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/116163300?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 118,
 'color': 'BEIGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'c79da8ac-2ee5-5b57-9c00-23bcd451d3fd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LB19GHN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/116163300',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'C3 AIRCROSS HATCHBACK',
 'odometer': 69209,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-04-30',
 'seller_name': 'AAM Group',
 'title': 'CITROEN C3 AIRCROSS HATCHBACK 1.2 PureTech Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27116163300%27 HTTP/1.1" 200 None
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Saving data for 116163300: {'auction_closing_time': 1764936000.0, 'created_time': 1764406991.851851, 'last_price_update_time': 1764875059.283255}
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='116163300') HTTP/1.1" 204 0
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117742183, 'registration': 'HV66CWU', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 82982, 'mileageWarranty': False, 'type': 'car', 'saleId': 17985, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T11:00Z', 'lot': 34, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-03', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'NON-RUNNER COLLECTION ONLY CHELMSFORD - ENGINE SEIZED MAY HAVE FURTHER FAULTS SOLD AS SEEN', 'virtual': True, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 89, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117742183, 'registration': 'HV66CWU', 'account': 'STA058', 'make': 'VAUXHALL', 'model': 'ASTRA DIESEL SPORTS TOURER', 'derivative': '1.6 CDTi 16V ecoFLEX Design 5dr', 'mileage': 82982, 'mileageWarranty': False, 'type': 'car', 'saleId': 17985, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T11:00Z', 'lot': 34, 'hall': 'Main Hall', 'transmission': 'manual', 'firstRegistration': '2016-10-03', 'fuel': 'Diesel', 'motExpiry': '2026-03-05', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600'], 'colour': 'SILVER', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Express', 'serviceHistory': '', 'remarks': 'NON-RUNNER COLLECTION ONLY CHELMSFORD - ENGINE SEIZED MAY HAVE FURTHER FAULTS SOLD AS SEEN', 'virtual': True, 'seller': 'Startline Motor Finance Ltd', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': None, 'co2': 89, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': None, 'assuredType': None, 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with identifier: 117742183
2025-12-04 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with scrape type 1
2025-12-04 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 1 photos for item 6aacc028-8ca3-593e-b8e0-ee55c6a65220
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fabimg003.imgix.net%252FHV66CWU%252F2025-12-03%252Fimage%252F195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg%253Fw%3D600%27 HTTP/1.1" 200 None
2025-12-04 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600 not downloaded yet
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117539707, 'registration': 'KW22MVT', 'account': 'STE131', 'make': 'DS', 'model': 'DS 4 HATCHBACK', 'derivative': '1.6 PureTech 225 Cross Rivoli 5dr EAT8', 'mileage': 22444, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KW22MVT/2025-11-26/image/57463a04-0883-4cb9-a555-5f43e2bcb544_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/831c3a78-7d0f-40f1-b86a-e95902372584_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/a3840dd9-1e02-4e58-8445-ff33e39df395_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/55897b34-e76f-4ba9-a986-db44640be84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/3a7a02f0-db30-420b-970c-d8ccf9c27add_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/f9b41ab1-7ba3-4958-ab3d-b71cd83cd741_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/3056a530-69c5-48e3-bc3e-f8a0d03e43d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/22dca106-4692-4b96-b5db-f6c033ea6225_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/43d44629-a2ec-4675-9bdd-46f722d0cabf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/1eb6c070-6fde-42d7-99e7-6a6ab52b6732_removebg.jpg?w=600'], 'colour': 'GOLD', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/23- 16K, 09/23- 10K, 09/24- 17K, 08/25- 21K DISCREPANCY ON PRINT', 'remarks': '**1898**VOSA STATES 21K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/820ab99c-a361-4157-bde0-3605757d904e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117539707, 'registration': 'KW22MVT', 'account': 'STE131', 'make': 'DS', 'model': 'DS 4 HATCHBACK', 'derivative': '1.6 PureTech 225 Cross Rivoli 5dr EAT8', 'mileage': 22444, 'mileageWarranty': False, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 125, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-08-31', 'fuel': 'Petrol', 'motExpiry': '2026-08-30', 'doors': 5, 'engineSize': 1598, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/KW22MVT/2025-11-26/image/57463a04-0883-4cb9-a555-5f43e2bcb544_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/831c3a78-7d0f-40f1-b86a-e95902372584_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/a3840dd9-1e02-4e58-8445-ff33e39df395_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/55897b34-e76f-4ba9-a986-db44640be84e_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/3a7a02f0-db30-420b-970c-d8ccf9c27add_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/f9b41ab1-7ba3-4958-ab3d-b71cd83cd741_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/3056a530-69c5-48e3-bc3e-f8a0d03e43d4_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/22dca106-4692-4b96-b5db-f6c033ea6225_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/43d44629-a2ec-4675-9bdd-46f722d0cabf_removebg.jpg?w=600', 'https://abimg003.imgix.net/KW22MVT/2025-11-26/image/1eb6c070-6fde-42d7-99e7-6a6ab52b6732_removebg.jpg?w=600'], 'colour': 'GOLD', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 08/23- 16K, 09/23- 10K, 09/24- 17K, 08/25- 21K DISCREPANCY ON PRINT', 'remarks': '**1898**VOSA STATES 21K', 'virtual': False, 'seller': 'Stellantis Financial Services UK', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 149, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/820ab99c-a361-4157-bde0-3605757d904e.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b0bba66-e466-5c01-87dd-fd46c3eb779b with identifier: 117539707
2025-12-04 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b0bba66-e466-5c01-87dd-fd46c3eb779b with scrape type 2
2025-12-04 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b0bba66-e466-5c01-87dd-fd46c3eb779b with scrape type 2
2025-12-04 19:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 7b0bba66-e466-5c01-87dd-fd46c3eb779b, identifier: 117539707
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115951209, 'registration': 'LA19WUX', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 64723, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19WUX/2025-10-08/image/1fcfa035-9bc6-410d-b819-3689de644157_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/bd68e1a8-afb5-44b0-9c07-ca83df050b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/1f3a55b8-9ebc-4fd1-b3f2-2777590e5b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/0ad62453-046d-4ec0-b9b2-99813db97130_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/3b3c225c-dc16-405c-8f09-6e1766020c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/887bacbe-b45d-41b8-8175-3c4ba9c7e62a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/823a1b8b-cb4e-483e-ae52-67235c6df50f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/92ac2b81-5837-4c4c-8731-e8bdbc52c92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/8e473677-1e1b-4b1e-9e75-a966c823ed10_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 21K- 35K- 47K - 57K', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73978fa5-e863-4aca-a099-05521a0f37fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115951209, 'registration': 'LA19WUX', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 64723, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-04-30', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19WUX/2025-10-08/image/1fcfa035-9bc6-410d-b819-3689de644157_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/bd68e1a8-afb5-44b0-9c07-ca83df050b46_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/1f3a55b8-9ebc-4fd1-b3f2-2777590e5b66_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/0ad62453-046d-4ec0-b9b2-99813db97130_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/3b3c225c-dc16-405c-8f09-6e1766020c10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/887bacbe-b45d-41b8-8175-3c4ba9c7e62a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/823a1b8b-cb4e-483e-ae52-67235c6df50f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/92ac2b81-5837-4c4c-8731-e8bdbc52c92a_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19WUX/2025-10-08/image/8e473677-1e1b-4b1e-9e75-a966c823ed10_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': '', 'remarks': 'NO V5 FORMER KEEPERS UNKNOWN - VOSA STATES 21K- 35K- 47K - 57K', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/73978fa5-e863-4aca-a099-05521a0f37fd.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2f62361-31bb-59bb-bd26-a21b6877434d with identifier: 115951209
2025-12-04 19:04:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2f62361-31bb-59bb-bd26-a21b6877434d with scrape type 2
2025-12-04 19:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2f62361-31bb-59bb-bd26-a21b6877434d with scrape type 2
2025-12-04 19:04:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: d2f62361-31bb-59bb-bd26-a21b6877434d, identifier: 115951209
2025-12-04 19:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/115951190?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 7b0bba66-e466-5c01-87dd-fd46c3eb779b with identifier: 117539707
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=GOLD HTTP/1.1" 200 None
2025-12-04 19:04:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2025-12-04 19:04:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 7b0bba66-e466-5c01-87dd-fd46c3eb779b with identifier: 117539707
2025-12-04 19:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 7b0bba66-e466-5c01-87dd-fd46c3eb779b with identifier: 117539707 to the API
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117539707?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 149,
 'color': 'GOLD',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '7b0bba66-e466-5c01-87dd-fd46c3eb779b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'KW22MVT',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117539707',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'DS',
 'model': 'DS 4 HATCHBACK',
 'odometer': 22444,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-31',
 'seller_name': 'Stellantis Financial Services UK',
 'title': 'DS DS 4 HATCHBACK 1.6 PureTech 225 Cross Rivoli 5dr EAT8',
 'transmission': 'automatic',
 'trim': '1.6 PureTech 225 Cross Rivoli 5dr EAT8',
 'vin': None,
 'year': 2022}
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117539707%27 HTTP/1.1" 200 None
2025-12-04 19:04:19 [astonbarclay.gb] INFO: Saving data for 117539707: {'auction_closing_time': 1764927900.0, 'created_time': 1764184355.003753, 'last_price_update_time': 1764875059.984737}
2025-12-04 19:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117539707') HTTP/1.1" 204 0
2025-12-04 19:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: d2f62361-31bb-59bb-bd26-a21b6877434d with identifier: 115951209
2025-12-04 19:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: d2f62361-31bb-59bb-bd26-a21b6877434d with identifier: 115951209
2025-12-04 19:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: d2f62361-31bb-59bb-bd26-a21b6877434d with identifier: 115951209 to the API
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115951209?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'd2f62361-31bb-59bb-bd26-a21b6877434d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LA19WUX',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115951209',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 64723,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'AAM Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 83 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951209%27 HTTP/1.1" 200 None
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Saving data for 115951209: {'auction_closing_time': 1764936000.0, 'created_time': 1764406992.186331, 'last_price_update_time': 1764875060.328179}
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115951209') HTTP/1.1" 204 0
2025-12-04 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117448541?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117240084?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'e-xchange', 'id': 115951190, 'registration': 'LA19XFN', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 64931, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XFN/2025-10-09/image/5dea4610-06dc-4074-b2bf-5963d14fd98f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/6922e8e1-be96-46a0-9eef-de8d36d68c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/31b54a82-9c6e-49f6-9f56-dac2ad005788_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/2540636b-2bb3-41d6-b1a9-08080f3234f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/b58bdc85-8ed8-4ccf-861d-cddf518e89f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/27f50e94-38b2-41f3-9407-58305332d217_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/e5e61784-7d76-40f7-a237-1c7ddb1fd4dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/a4f239d8-87ab-43af-b8b4-d2de0dc6ad10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/455efa2b-291c-4d8e-b7bf-2c8eeb83e360_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 11/20 18K -', 'remarks': 'VOSA IN KM AND MILES VOSA STATES 26K- 39K -50K- 100K(KM)- SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3d1541b8-2061-4866-b864-e3a14a541127.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'e-xchange', 'id': 115951190, 'registration': 'LA19XFN', 'account': 'ALL002', 'make': 'CITROEN', 'model': 'C3 HATCHBACK', 'derivative': '1.2 PureTech 83 Flair 5dr', 'mileage': 64931, 'mileageWarranty': True, 'type': 'car', 'saleId': 20251205, 'siteId': 99, 'site': {'id': 99, 'name': 'Aston Barclay Digital', 'vehicles': 115}, 'saleStart': '2025-12-05T12:00Z', 'lot': None, 'hall': None, 'transmission': 'manual', 'firstRegistration': '2019-05-31', 'fuel': 'Petrol', 'motExpiry': '2026-05-12', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/LA19XFN/2025-10-09/image/5dea4610-06dc-4074-b2bf-5963d14fd98f_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/6922e8e1-be96-46a0-9eef-de8d36d68c71_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/31b54a82-9c6e-49f6-9f56-dac2ad005788_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/2540636b-2bb3-41d6-b1a9-08080f3234f5_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/b58bdc85-8ed8-4ccf-861d-cddf518e89f4_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/27f50e94-38b2-41f3-9407-58305332d217_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/e5e61784-7d76-40f7-a237-1c7ddb1fd4dc_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/a4f239d8-87ab-43af-b8b4-d2de0dc6ad10_removebg.jpg?w=600', 'https://abimg003.imgix.net/LA19XFN/2025-10-09/image/455efa2b-291c-4d8e-b7bf-2c8eeb83e360_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Dealer', 'serviceHistory': 'Service book 11/20 18K -', 'remarks': 'VOSA IN KM AND MILES VOSA STATES 26K- 39K -50K- 100K(KM)- SPARE KEY IN OFFICE', 'virtual': True, 'seller': 'AAM Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': None, 'v5': False, 'v5details': 'TF', 'co2': 99, 'location': {'siteId': '1', 'description': 'Aston Barclay Chelmsford'}, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/3d1541b8-2061-4866-b864-e3a14a541127.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b007e38f-24e9-5687-83a0-cb0739246bf8 with identifier: 115951190
2025-12-04 19:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b007e38f-24e9-5687-83a0-cb0739246bf8 with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b007e38f-24e9-5687-83a0-cb0739246bf8 with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: b007e38f-24e9-5687-83a0-cb0739246bf8, identifier: 115951190
2025-12-04 19:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: b007e38f-24e9-5687-83a0-cb0739246bf8 with identifier: 115951190
2025-12-04 19:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: b007e38f-24e9-5687-83a0-cb0739246bf8 with identifier: 115951190
2025-12-04 19:04:20 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: b007e38f-24e9-5687-83a0-cb0739246bf8 with identifier: 115951190 to the API
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/115951190?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 99,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T12:00:00Z',
 'fuel_type': 'Petrol',
 'id': 'b007e38f-24e9-5687-83a0-cb0739246bf8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'LA19XFN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/115951190',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'CITROEN',
 'model': 'C3 HATCHBACK',
 'odometer': 64931,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': 'AAM Group',
 'title': 'CITROEN C3 HATCHBACK 1.2 PureTech 83 Flair 5dr',
 'transmission': 'manual',
 'trim': '1.2 PureTech 83 Flair 5dr',
 'vin': None,
 'year': 2019}
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27115951190%27 HTTP/1.1" 200 None
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Saving data for 115951190: {'auction_closing_time': 1764936000.0, 'created_time': 1764406998.979458, 'last_price_update_time': 1764875060.69556}
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='115951190') HTTP/1.1" 204 0
2025-12-04 19:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600> (referer: https://catalogue.astonbarclay.net/api/vehicle/details/117742183?view=catalogue)
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117448541, 'registration': 'PL72WKW', 'account': 'VAN052', 'make': 'CITROEN', 'model': 'C3 YOU PURETECH S/S', 'derivative': None, 'mileage': 35223, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 33, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PL72WKW/2025-11-26/image/bdfeb237-4a12-4205-be41-41d627450b60_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/b97ac3a7-cd27-4c9d-9307-73f3563a455a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/5050ff0c-0fd1-4d5b-ad3c-d9e52892a688_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/f0fd52dc-9d59-44eb-9949-b660b8bf8d54_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/48d066e7-0cd8-4d8d-95d9-83d46fe6ca88_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/f60a6f58-81f7-4852-8dac-c5dce06eb861_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/61369d40-458e-49f8-b944-0ca3491c762f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/3dc8a54d-62c1-47cf-9f28-5a906b0755d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/da9b63c2-1f02-4e52-b807-9af1f717557d_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23- 10K, 09/24- 21K, 09/25- 34K', 'remarks': '**51** VOSA STATES 34K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3489de5-2232-4dad-b7b6-125980cf3ee7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117448541, 'registration': 'PL72WKW', 'account': 'VAN052', 'make': 'CITROEN', 'model': 'C3 YOU PURETECH S/S', 'derivative': None, 'mileage': 35223, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 33, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-09-30', 'fuel': 'Petrol', 'motExpiry': '2026-09-29', 'doors': 5, 'engineSize': 1199, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/PL72WKW/2025-11-26/image/bdfeb237-4a12-4205-be41-41d627450b60_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/b97ac3a7-cd27-4c9d-9307-73f3563a455a_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/5050ff0c-0fd1-4d5b-ad3c-d9e52892a688_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/f0fd52dc-9d59-44eb-9949-b660b8bf8d54_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/48d066e7-0cd8-4d8d-95d9-83d46fe6ca88_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/f60a6f58-81f7-4852-8dac-c5dce06eb861_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/61369d40-458e-49f8-b944-0ca3491c762f_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/3dc8a54d-62c1-47cf-9f28-5a906b0755d3_removebg.jpg?w=600', 'https://abimg003.imgix.net/PL72WKW/2025-11-26/image/da9b63c2-1f02-4e52-b807-9af1f717557d_removebg.jpg?w=600'], 'colour': 'BEIGE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 09/23- 10K, 09/24- 21K, 09/25- 34K', 'remarks': '**51** VOSA STATES 34K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 123, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/e3489de5-2232-4dad-b7b6-125980cf3ee7.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3b6162b0-cc28-5779-b36f-473fe905f401 with identifier: 117448541
2025-12-04 19:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3b6162b0-cc28-5779-b36f-473fe905f401 with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3b6162b0-cc28-5779-b36f-473fe905f401 with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 3b6162b0-cc28-5779-b36f-473fe905f401, identifier: 117448541
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117240084, 'registration': 'YN21AHH', 'account': 'LEA009', 'make': 'BMW', 'model': 'X1 ESTATE', 'derivative': 'xDrive 25e xLine 5dr Auto', 'mileage': 45616, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 48, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN21AHH/2025-11-25/image/c315d355-ffd1-4029-b569-acac081fbbb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/e37ffc57-8872-40e5-8379-5e8cb7c0a506_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/63d99beb-3b9d-4fdf-b44f-f77f0cf11dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/d3c18a31-0562-42be-91ec-2272f374aed4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/20a8088d-423c-4638-abf8-1872c053a007_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/23564b82-5942-4f9e-984e-d1e8f649f650_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/67c4ab7d-480a-4ce5-a436-628b97dfa5c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/f8cb2747-36f0-463c-b1d3-39805ca82340_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/72726b96-df27-433d-993f-d61791bdae92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/a9831502-5a9a-4e87-91ed-f3a3e8653ce0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 05/23 - 18K, 07/24 - 30K, 02/25 - 37K', 'remarks': '**937**VOSA STATES 30K, 42K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe200076-5048-4d93-8df0-99ac84be0649.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:20 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117240084, 'registration': 'YN21AHH', 'account': 'LEA009', 'make': 'BMW', 'model': 'X1 ESTATE', 'derivative': 'xDrive 25e xLine 5dr Auto', 'mileage': 45616, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 48, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-08-16', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-08-15', 'doors': 5, 'engineSize': 1499, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/YN21AHH/2025-11-25/image/c315d355-ffd1-4029-b569-acac081fbbb4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/e37ffc57-8872-40e5-8379-5e8cb7c0a506_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/63d99beb-3b9d-4fdf-b44f-f77f0cf11dd5_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/d3c18a31-0562-42be-91ec-2272f374aed4_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/20a8088d-423c-4638-abf8-1872c053a007_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/23564b82-5942-4f9e-984e-d1e8f649f650_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/67c4ab7d-480a-4ce5-a436-628b97dfa5c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/f8cb2747-36f0-463c-b1d3-39805ca82340_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/72726b96-df27-433d-993f-d61791bdae92_removebg.jpg?w=600', 'https://abimg003.imgix.net/YN21AHH/2025-11-25/image/a9831502-5a9a-4e87-91ed-f3a3e8653ce0_removebg.jpg?w=600'], 'colour': 'WHITE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service digital I DRIVE 05/23 - 18K, 07/24 - 30K, 02/25 - 37K', 'remarks': '**937**VOSA STATES 30K, 42K SPARE KEY CHARGING CABLE', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 41, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/fe200076-5048-4d93-8df0-99ac84be0649.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133621b5-cdf7-5393-a387-49c49d5852ff with identifier: 117240084
2025-12-04 19:04:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133621b5-cdf7-5393-a387-49c49d5852ff with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133621b5-cdf7-5393-a387-49c49d5852ff with scrape type 2
2025-12-04 19:04:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 133621b5-cdf7-5393-a387-49c49d5852ff, identifier: 117240084
2025-12-04 19:04:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 3b6162b0-cc28-5779-b36f-473fe905f401 with identifier: 117448541
2025-12-04 19:04:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 3b6162b0-cc28-5779-b36f-473fe905f401 with identifier: 117448541
2025-12-04 19:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 3b6162b0-cc28-5779-b36f-473fe905f401 with identifier: 117448541 to the API
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:21 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 3b6162b0-cc28-5779-b36f-473fe905f401: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"Trim","ErrorMessage":"car trim can\u0027t be null","ErrorCode":0}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:20 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117448541?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 123,
 'color': 'BEIGE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '3b6162b0-cc28-5779-b36f-473fe905f401',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'PL72WKW',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117448541',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'CITROEN',
 'model': 'C3 YOU PURETECH S/S',
 'odometer': 35223,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-30',
 'seller_name': 'Vantage Motor Group',
 'title': 'CITROEN C3 YOU PURETECH S/S None',
 'transmission': 'automatic',
 'trim': None,
 'vin': None,
 'year': 2022}
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117448541%27 HTTP/1.1" 200 None
2025-12-04 19:04:21 [astonbarclay.gb] INFO: Saving data for 117448541: {'auction_closing_time': 1764927900.0, 'created_time': 1764184176.742988, 'last_price_update_time': 1764875061.197386}
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117448541') HTTP/1.1" 204 0
2025-12-04 19:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 133621b5-cdf7-5393-a387-49c49d5852ff with identifier: 117240084
2025-12-04 19:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 133621b5-cdf7-5393-a387-49c49d5852ff with identifier: 117240084
2025-12-04 19:04:21 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 133621b5-cdf7-5393-a387-49c49d5852ff with identifier: 117240084 to the API
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117240084?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 41,
 'color': 'WHITE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '133621b5-cdf7-5393-a387-49c49d5852ff',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'YN21AHH',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117240084',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'BMW',
 'model': 'X1 ESTATE',
 'odometer': 45616,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-08-16',
 'seller_name': 'Zenith',
 'title': 'BMW X1 ESTATE xDrive 25e xLine 5dr Auto',
 'transmission': 'automatic',
 'trim': 'xDrive 25e xLine 5dr Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117240084%27 HTTP/1.1" 200 None
2025-12-04 19:04:21 [astonbarclay.gb] INFO: Saving data for 117240084: {'auction_closing_time': 1764927900.0, 'created_time': 1764184173.311433, 'last_price_update_time': 1764875061.528346}
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117240084') HTTP/1.1" 204 0
2025-12-04 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117374089?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7fdfd5b44b10>
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 1969
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2025-12-04 19:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6aacc028-8ca3-593e-b8e0-ee55c6a65220/6aacc028-8ca3-593e-b8e0-ee55c6a65220_image_0.jpg HTTP/1.1" 201 0
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='astonbarclay.gb',RowKey='https%3A%252F%252Fabimg003.imgix.net%252FHV66CWU%252F2025-12-03%252Fimage%252F195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg%253Fw%3D600') HTTP/1.1" 204 0
2025-12-04 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600 saved to cache
2025-12-04 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6aacc028-8ca3-593e-b8e0-ee55c6a65220
2025-12-04 19:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6aacc028-8ca3-593e-b8e0-ee55c6a65220, skipping ID generation
2025-12-04 19:04:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with scrape type 1
2025-12-04 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Removing item 6aacc028-8ca3-593e-b8e0-ee55c6a65220 from tracking dictionaries
2025-12-04 19:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6aacc028-8ca3-593e-b8e0-ee55c6a65220 sending to next pipeline
2025-12-04 19:04:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6aacc028-8ca3-593e-b8e0-ee55c6a65220, identifier: 117742183
2025-12-04 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117555034?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117555641?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://catalogue.astonbarclay.net/api/vehicle/details/117427071?view=catalogue> (referer: https://catalogue.astonbarclay.net/vehicle-search) ['zyte-api']
2025-12-04 19:04:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with identifier: 117742183
2025-12-04 19:04:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with identifier: 117742183
2025-12-04 19:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6aacc028-8ca3-593e-b8e0-ee55c6a65220 with identifier: 117742183 to the API
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600>
{'auction_title': '',
 'c_o_2_emission_value': 89,
 'color': 'SILVER',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'expiration_date': '2025-12-05T11:00:00Z',
 'fuel_type': 'Diesel',
 'id': '6aacc028-8ca3-593e-b8e0-ee55c6a65220',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'HV66CWU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117742183',
 'listing': 'auction',
 'location': 'Aston Barclay Digital',
 'make': 'VAUXHALL',
 'model': 'ASTRA DIESEL SPORTS TOURER',
 'odometer': 82982,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 1,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6aacc028-8ca3-593e-b8e0-ee55c6a65220/6aacc028-8ca3-593e-b8e0-ee55c6a65220_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 32125,
             'Height': 800,
             'OriginUrl': 'https://abimg003.imgix.net/HV66CWU/2025-12-03/image/195eb0c9-5acf-4f32-ab2e-b458bdff7e64_removebg.jpg?w=600',
             'Width': 600}],
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-03',
 'seller_name': 'Startline Motor Finance Ltd',
 'title': 'VAUXHALL ASTRA DIESEL SPORTS TOURER 1.6 CDTi 16V ecoFLEX Design 5dr',
 'transmission': 'manual',
 'trim': '1.6 CDTi 16V ecoFLEX Design 5dr',
 'vin': None,
 'year': 2016}
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117742183%27 HTTP/1.1" 200 None
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Saving data for 117742183: {'created_time': 1764875062.305145, 'last_price_update_time': 1764875062.305154, 'auction_closing_time': 1764932400.0}
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117742183') HTTP/1.1" 204 0
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117374089, 'registration': 'YS72XZA', 'account': 'VAN047', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 24828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-14', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS72XZA/2025-11-24/image/2916e2cc-acf5-4768-ae52-8b82d9ff12d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/d388ba2e-a5ff-41ff-b47f-fbb1efbb05bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/f214e5dd-a9a3-4bca-b6f1-0b83f95da727_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/ceeb762c-7c49-41b2-94ab-720cb20437e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/a9337dda-8024-4b00-a24a-fdc273f4ab04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/5e551938-6b2e-4886-8672-05639c222d5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/7d97892c-945b-467f-91ca-6f12d917f57a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/a6f6339a-bb30-4f73-a1d5-ba33ec4aaae1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/814d1945-2130-4674-9ff1-2f2334b8e611_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/23 - 9K, 02/25 - 18K', 'remarks': '**1305**VOSA STATES 24K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85fd5421-da18-4b08-9603-eab6ae4690cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117374089, 'registration': 'YS72XZA', 'account': 'VAN047', 'make': 'NISSAN', 'model': 'QASHQAI HATCHBACK', 'derivative': '1.5 E-Power Tekna 5dr Auto', 'mileage': 24828, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 31, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2022-12-14', 'fuel': 'Petrol/Electric Hybrid', 'motExpiry': '2026-12-13', 'doors': 5, 'engineSize': 1497, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YS72XZA/2025-11-24/image/2916e2cc-acf5-4768-ae52-8b82d9ff12d9_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/d388ba2e-a5ff-41ff-b47f-fbb1efbb05bf_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/f214e5dd-a9a3-4bca-b6f1-0b83f95da727_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/ceeb762c-7c49-41b2-94ab-720cb20437e2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/a9337dda-8024-4b00-a24a-fdc273f4ab04_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/5e551938-6b2e-4886-8672-05639c222d5f_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/7d97892c-945b-467f-91ca-6f12d917f57a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/a6f6339a-bb30-4f73-a1d5-ba33ec4aaae1_removebg.jpg?w=600', 'https://abimg003.imgix.net/YS72XZA/2025-11-24/image/814d1945-2130-4674-9ff1-2f2334b8e611_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print and book 12/23 - 9K, 02/25 - 18K', 'remarks': '**1305**VOSA STATES 24K', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 122, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/85fd5421-da18-4b08-9603-eab6ae4690cb.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b822f31-5628-51ac-bc5c-9a1167e9e90f with identifier: 117374089
2025-12-04 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b822f31-5628-51ac-bc5c-9a1167e9e90f with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b822f31-5628-51ac-bc5c-9a1167e9e90f with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 4b822f31-5628-51ac-bc5c-9a1167e9e90f, identifier: 117374089
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117555034, 'registration': 'YK73ELN', 'account': 'VAN041', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 2142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-12-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK73ELN/2025-12-01/image/419f91cc-84db-4d44-bcde-b0db403888b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/acf6bb21-9ebf-4b4f-89ce-20f512664677_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/156472b0-24cf-4a5c-9593-d9f4a9bdf9a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/324ae634-ce57-4278-ad9a-66968efc03a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/9822e10f-641b-4c23-890c-280507e89fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/f57a1909-32bc-4bec-a2c4-6ba1d5ca3028_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/f282790c-cf80-4c11-9b66-2ad7da889f6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/ec28d271-f046-4d38-8a82-026c84dfbb47_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/e9f0d585-6a4d-4f71-8f5c-f1091cd010cf_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/25 - 1K', 'remarks': '**1918**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7a8af780-24f7-44ee-9dd4-b5ba4a63f435.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117555034, 'registration': 'YK73ELN', 'account': 'VAN041', 'make': 'RENAULT', 'model': 'CLIO HATCHBACK', 'derivative': '1.0 TCe 90 Evolution 5dr', 'mileage': 2142, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 30, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-12-29', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YK73ELN/2025-12-01/image/419f91cc-84db-4d44-bcde-b0db403888b8_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/acf6bb21-9ebf-4b4f-89ce-20f512664677_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/156472b0-24cf-4a5c-9593-d9f4a9bdf9a7_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/324ae634-ce57-4278-ad9a-66968efc03a2_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/9822e10f-641b-4c23-890c-280507e89fb0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/f57a1909-32bc-4bec-a2c4-6ba1d5ca3028_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/f282790c-cf80-4c11-9b66-2ad7da889f6a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/ec28d271-f046-4d38-8a82-026c84dfbb47_removebg.jpg?w=600', 'https://abimg003.imgix.net/YK73ELN/2025-12-01/image/e9f0d585-6a4d-4f71-8f5c-f1091cd010cf_removebg.jpg?w=600'], 'colour': 'RED', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service book 03/25 - 1K', 'remarks': '**1918**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '1', 'v5': True, 'v5details': 'Here', 'co2': 119, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/7a8af780-24f7-44ee-9dd4-b5ba4a63f435.pdf', 'assuredType': 'AA', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6796da09-633c-589b-9a21-f5e252878eb9 with identifier: 117555034
2025-12-04 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6796da09-633c-589b-9a21-f5e252878eb9 with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6796da09-633c-589b-9a21-f5e252878eb9 with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 6796da09-633c-589b-9a21-f5e252878eb9, identifier: 117555034
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117555641, 'registration': 'YW23BJU', 'account': 'VAN040', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr', 'mileage': 14612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 32, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YW23BJU/2025-12-02/image/dda97089-11e9-4866-9a59-146b3c723c2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/4202c580-494a-4da2-a7a8-56f88405b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/e3337b2c-c3bd-4a03-ad80-35b5a8cd03ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/1bd55ab6-22aa-42c2-af08-5d4421d913c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/9f580486-2f84-49bb-b12f-417869c8e680_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/d1ab1e8b-dc62-432c-9115-0e5b5d8d65bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/f3937491-65cb-4971-83c9-4f44cf8fbbdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/8a302ce6-7fbc-497e-a0aa-c0a549071d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/1735f953-8203-4369-9562-05bc09258341_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1283**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/750ca036-7754-4465-93c8-c32cc2a9121b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117555641, 'registration': 'YW23BJU', 'account': 'VAN040', 'make': 'FORD', 'model': 'PUMA HATCHBACK', 'derivative': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr', 'mileage': 14612, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 32, 'hall': 'Hall 1', 'transmission': 'manual', 'firstRegistration': '2023-07-17', 'fuel': 'Petrol', 'motExpiry': None, 'doors': 5, 'engineSize': 999, 'bodyType': 'Hatchback', 'images': ['https://abimg003.imgix.net/YW23BJU/2025-12-02/image/dda97089-11e9-4866-9a59-146b3c723c2a_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/4202c580-494a-4da2-a7a8-56f88405b695_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/e3337b2c-c3bd-4a03-ad80-35b5a8cd03ce_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/1bd55ab6-22aa-42c2-af08-5d4421d913c0_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/9f580486-2f84-49bb-b12f-417869c8e680_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/d1ab1e8b-dc62-432c-9115-0e5b5d8d65bd_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/f3937491-65cb-4971-83c9-4f44cf8fbbdc_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/8a302ce6-7fbc-497e-a0aa-c0a549071d4c_removebg.jpg?w=600', 'https://abimg003.imgix.net/YW23BJU/2025-12-02/image/1735f953-8203-4369-9562-05bc09258341_removebg.jpg?w=600'], 'colour': 'BLUE', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': '', 'remarks': '**1283**', 'virtual': False, 'seller': 'Vantage Motor Group', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': True, 'v5details': 'Here', 'co2': 130, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/750ca036-7754-4465-93c8-c32cc2a9121b.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Margin', 'value': 'M'}}
2025-12-04 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 044f7f2c-c04c-5097-9386-e881e03b2dca with identifier: 117555641
2025-12-04 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 044f7f2c-c04c-5097-9386-e881e03b2dca with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 044f7f2c-c04c-5097-9386-e881e03b2dca with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 044f7f2c-c04c-5097-9386-e881e03b2dca, identifier: 117555641
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Detail data: {'cardType': 'catalogue', 'id': 117427071, 'registration': 'FV71BYP', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 250e AMG Line Premium Plus 5dr Tip Auto', 'mileage': 83444, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 56, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV71BYP/2025-11-25/image/ed4fc02e-608c-42e7-84de-20da63b93be0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/67d9ca6f-802b-4c34-a86c-b60b3cb08bc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/21b6849b-4646-4afd-88a3-82f73952e084_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/6ab7e6f2-bfdd-4859-8bbf-7e9b2212c69d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/f90da233-1adc-4d50-a8e5-6e05ce3ba976_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/73ab4667-3612-45fa-9a73-c699b3abb4cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/c306b3e8-342c-4b35-8cc2-51666d423015_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/20441d90-6485-4729-bc20-432e29aafd19_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/cfff3c21-01a9-444d-8a6f-2c7c6976a0a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22 - 17K, 04/23 - 35K', 'remarks': '**747**VOSA STATES 61K, 81K SPARE KEY CHARGING CABLE Amg-leathr Two Tone Titanium Grypearl Bk; Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5836481c-713c-47f1-bd6d-83a14e93025f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Extracting listing item: {'cardType': 'catalogue', 'id': 117427071, 'registration': 'FV71BYP', 'account': 'ZEN002', 'make': 'MERCEDES-BENZ', 'model': 'CLA SHOOTING BRAKE', 'derivative': 'CLA 250e AMG Line Premium Plus 5dr Tip Auto', 'mileage': 83444, 'mileageWarranty': True, 'type': 'car', 'saleId': 17898, 'siteId': 34457511, 'site': {'id': 34457511, 'name': 'Aston Barclay Wakefield', 'vehicles': 273}, 'saleStart': '2025-12-05T09:45Z', 'lot': 56, 'hall': 'Hall 1', 'transmission': 'automatic', 'firstRegistration': '2021-11-02', 'fuel': 'Petrol/Plugin Electric Hybrid', 'motExpiry': '2026-11-07', 'doors': 5, 'engineSize': 1332, 'bodyType': 'Estate', 'images': ['https://abimg003.imgix.net/FV71BYP/2025-11-25/image/ed4fc02e-608c-42e7-84de-20da63b93be0_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/67d9ca6f-802b-4c34-a86c-b60b3cb08bc4_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/21b6849b-4646-4afd-88a3-82f73952e084_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/6ab7e6f2-bfdd-4859-8bbf-7e9b2212c69d_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/f90da233-1adc-4d50-a8e5-6e05ce3ba976_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/73ab4667-3612-45fa-9a73-c699b3abb4cf_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/c306b3e8-342c-4b35-8cc2-51666d423015_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/20441d90-6485-4729-bc20-432e29aafd19_removebg.jpg?w=600', 'https://abimg003.imgix.net/FV71BYP/2025-11-25/image/cfff3c21-01a9-444d-8a6f-2c7c6976a0a2_removebg.jpg?w=600'], 'colour': 'GREY', 'writeoffcode': '', 'grade': None, 'nonRunner': False, 'inspectionType': 'Zenith', 'serviceHistory': 'Service print 07/22 - 17K, 04/23 - 35K', 'remarks': '**747**VOSA STATES 61K, 81K SPARE KEY CHARGING CABLE Amg-leathr Two Tone Titanium Grypearl Bk; Metallic Paint', 'virtual': False, 'seller': 'Zenith', 'sellerPostcode': None, 'sellerStreetOne': None, 'sellerStreetTwo': None, 'sellerTown': None, 'sellerId': None, 'formerKeepers': '0', 'v5': False, 'v5details': 'TF', 'co2': 25, 'location': None, 'spinCar': None, 'spinCarUrl': None, 'assuredUrl': 'https://abimg002.imgix.net/5836481c-713c-47f1-bd6d-83a14e93025f.pdf', 'assuredType': 'AA EV/Hybrid', 'imported': False, 'eurostatus': 6, 'vatStatus': {'label': 'Qualifying', 'value': 'Q'}}
2025-12-04 19:04:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with identifier: 117427071
2025-12-04 19:04:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with scrape type 2
2025-12-04 19:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: astonbarclay.gb, Processed item id: 2a83c79a-b01c-5aad-9c1f-efbe760c5f32, identifier: 117427071
2025-12-04 19:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 4b822f31-5628-51ac-bc5c-9a1167e9e90f with identifier: 117374089
2025-12-04 19:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 4b822f31-5628-51ac-bc5c-9a1167e9e90f with identifier: 117374089
2025-12-04 19:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 4b822f31-5628-51ac-bc5c-9a1167e9e90f with identifier: 117374089 to the API
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117374089?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 122,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Electric Hybrid',
 'id': '4b822f31-5628-51ac-bc5c-9a1167e9e90f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YS72XZA',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117374089',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'NISSAN',
 'model': 'QASHQAI HATCHBACK',
 'odometer': 24828,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-14',
 'seller_name': 'Vantage Motor Group',
 'title': 'NISSAN QASHQAI HATCHBACK 1.5 E-Power Tekna 5dr Auto',
 'transmission': 'automatic',
 'trim': '1.5 E-Power Tekna 5dr Auto',
 'vin': None,
 'year': 2022}
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117374089%27 HTTP/1.1" 200 None
2025-12-04 19:04:22 [astonbarclay.gb] INFO: Saving data for 117374089: {'auction_closing_time': 1764927900.0, 'created_time': 1763665370.326115, 'last_price_update_time': 1764875062.987743}
2025-12-04 19:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117374089') HTTP/1.1" 204 0
2025-12-04 19:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 6796da09-633c-589b-9a21-f5e252878eb9 with identifier: 117555034
2025-12-04 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 6796da09-633c-589b-9a21-f5e252878eb9 with identifier: 117555034
2025-12-04 19:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 6796da09-633c-589b-9a21-f5e252878eb9 with identifier: 117555034 to the API
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%276796da09-633c-589b-9a21-f5e252878eb9%27 HTTP/1.1" 200 None
2025-12-04 19:04:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 6796da09-633c-589b-9a21-f5e252878eb9: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117555034?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 119,
 'color': 'RED',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '6796da09-633c-589b-9a21-f5e252878eb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YK73ELN',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117555034',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'RENAULT',
 'model': 'CLIO HATCHBACK',
 'odometer': 2142,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-12-29',
 'seller_name': 'Vantage Motor Group',
 'title': 'RENAULT CLIO HATCHBACK 1.0 TCe 90 Evolution 5dr',
 'transmission': 'manual',
 'trim': '1.0 TCe 90 Evolution 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555034%27 HTTP/1.1" 200 None
2025-12-04 19:04:23 [astonbarclay.gb] INFO: Saving data for 117555034: {'auction_closing_time': 1764927900.0, 'created_time': 1764270166.603718, 'last_price_update_time': 1764875063.277772}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117555034') HTTP/1.1" 204 0
2025-12-04 19:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 044f7f2c-c04c-5097-9386-e881e03b2dca with identifier: 117555641
2025-12-04 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 044f7f2c-c04c-5097-9386-e881e03b2dca with identifier: 117555641
2025-12-04 19:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 044f7f2c-c04c-5097-9386-e881e03b2dca with identifier: 117555641 to the API
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 422 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27044f7f2c-c04c-5097-9386-e881e03b2dca%27 HTTP/1.1" 200 None
2025-12-04 19:04:23 [crawlers.pipelines.post_to_api] ERROR: astonbarclay.gb, item_id 044f7f2c-c04c-5097-9386-e881e03b2dca: Failed to post item to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing: 422 Client Error: Unprocessable Entity for url: https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
 | Status Code: 422
 | Response Content: {"ValidationErrors":[{"PropertyName":"","ErrorMessage":"Images required for new listing","ErrorCode":4}],"WasSuccessful":false}
 | Response Headers: {'Content-Type': 'application/json', 'Date': 'Thu, 04 Dec 2025 19:04:22 GMT', 'Request-Context': 'appId=cid-v1:1a14ebe8-38cd-4629-ab2d-40684250fa5b', 'Server': 'Kestrel', 'Strict-Transport-Security': 'max-age=31536000; includeSubDomains; preload', 'Transfer-Encoding': 'chunked'}

2025-12-04 19:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117555641?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 130,
 'color': 'BLUE',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol',
 'id': '044f7f2c-c04c-5097-9386-e881e03b2dca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': True,
 'license_plate': 'YW23BJU',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117555641',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'FORD',
 'model': 'PUMA HATCHBACK',
 'odometer': 14612,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-17',
 'seller_name': 'Vantage Motor Group',
 'title': 'FORD PUMA HATCHBACK 1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale '
          '5dr',
 'transmission': 'manual',
 'trim': '1.0 EcoBoost Hybrid mHEV 155 ST-Line Vignale 5dr',
 'vin': None,
 'year': 2023}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117555641%27 HTTP/1.1" 200 None
2025-12-04 19:04:23 [astonbarclay.gb] INFO: Saving data for 117555641: {'auction_closing_time': 1764927900.0, 'created_time': 1764270168.510302, 'last_price_update_time': 1764875063.558199}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117555641') HTTP/1.1" 204 0
2025-12-04 19:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: astonbarclay.gb, Translating item: 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with identifier: 117427071
2025-12-04 19:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: astonbarclay.gb, Applying rules to item: 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with identifier: 117427071
2025-12-04 19:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: astonbarclay.gb, Posting item: 2a83c79a-b01c-5aad-9c1f-efbe760c5f32 with identifier: 117427071 to the API
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2025-12-04 19:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://catalogue.astonbarclay.net/api/vehicle/details/117427071?view=catalogue>
{'auction_title': '',
 'c_o_2_emission_value': 25,
 'color': 'GREY',
 'currency': 'GBP',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'expiration_date': '2025-12-05T09:45:00Z',
 'fuel_type': 'Petrol/Plugin Electric Hybrid',
 'id': '2a83c79a-b01c-5aad-9c1f-efbe760c5f32',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': False,
 'license_plate': 'FV71BYP',
 'link_to_web_offer': 'https://catalogue.astonbarclay.net/details/catalogue/117427071',
 'listing': 'auction',
 'location': 'Aston Barclay Wakefield',
 'make': 'MERCEDES-BENZ',
 'model': 'CLA SHOOTING BRAKE',
 'odometer': 83444,
 'odometer_reading_unit': 'mi',
 'origin_country_code': 'GB',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-11-02',
 'seller_name': 'Zenith',
 'title': 'MERCEDES-BENZ CLA SHOOTING BRAKE CLA 250e AMG Line Premium Plus 5dr '
          'Tip Auto',
 'transmission': 'automatic',
 'trim': 'CLA 250e AMG Line Premium Plus 5dr Tip Auto',
 'vin': None,
 'year': 2021}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20RowKey%20eq%20%27117427071%27 HTTP/1.1" 200 None
2025-12-04 19:04:23 [astonbarclay.gb] INFO: Saving data for 117427071: {'auction_closing_time': 1764927900.0, 'created_time': 1764183915.614967, 'last_price_update_time': 1764875063.873613}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='astonbarclay.gb',RowKey='117427071') HTTP/1.1" 204 0
2025-12-04 19:04:23 [scrapy.core.engine] INFO: Closing spider (finished)
2025-12-04 19:04:23 [astonbarclay.gb] INFO: astonbarclay.gb Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 1, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 2}
2025-12-04 19:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2025-12-04 19:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27astonbarclay.gb%27%20and%20last_price_update_time%20lt%201764443063 HTTP/1.1" 200 None
2025-12-04 19:04:24 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (217 items) in: file:///var/lib/scrapyd/items/sourcing_v2/astonbarclay.gb/task_36_2025-12-04T19_00_00.jl
2025-12-04 19:04:24 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 330288,
 'downloader/request_count': 588,
 'downloader/request_method_count/GET': 588,
 'downloader/response_bytes': 14517905,
 'downloader/response_count': 588,
 'downloader/response_status_count/200': 588,
 'elapsed_time_seconds': 258.479552,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2025, 12, 4, 19, 4, 24, 177017, tzinfo=datetime.timezone.utc),
 'item_dropped_count': 94,
 'item_dropped_reasons_count/DropItem': 94,
 'item_scraped_count': 217,
 'log_count/DEBUG': 7250,
 'log_count/ERROR': 105,
 'log_count/INFO': 7470,
 'memusage/max': 168435712,
 'memusage/startup': 127430656,
 'photo_download_count': 275,
 'playwright/context_count': 1,
 'playwright/context_count/max_concurrent': 1,
 'playwright/context_count/persistent/False': 1,
 'playwright/context_count/remote/False': 1,
 'playwright/page_count': 1,
 'playwright/page_count/max_concurrent': 1,
 'playwright/request_count': 78,
 'playwright/request_count/aborted': 42,
 'playwright/request_count/method/GET': 55,
 'playwright/request_count/method/HEAD': 12,
 'playwright/request_count/method/POST': 11,
 'playwright/request_count/navigation': 2,
 'playwright/request_count/resource_type/document': 2,
 'playwright/request_count/resource_type/fetch': 22,
 'playwright/request_count/resource_type/font': 2,
 'playwright/request_count/resource_type/image': 30,
 'playwright/request_count/resource_type/script': 7,
 'playwright/request_count/resource_type/stylesheet': 2,
 'playwright/request_count/resource_type/xhr': 13,
 'playwright/response_count': 36,
 'playwright/response_count/method/GET': 25,
 'playwright/response_count/method/POST': 11,
 'playwright/response_count/resource_type/document': 2,
 'playwright/response_count/resource_type/fetch': 10,
 'playwright/response_count/resource_type/font': 2,
 'playwright/response_count/resource_type/script': 7,
 'playwright/response_count/resource_type/stylesheet': 2,
 'playwright/response_count/resource_type/xhr': 13,
 'request_depth_max': 3,
 'response_received_count': 313,
 'scheduler/dequeued': 588,
 'scheduler/dequeued/memory': 588,
 'scheduler/enqueued': 588,
 'scheduler/enqueued/memory': 588,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 312,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 5.049594515147286,
 'scrapy-zyte-api/mean_response_seconds': 5.050848274739114,
 'scrapy-zyte-api/processed': 312,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 312,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 312,
 'scrapy-zyte-api/request_args/httpResponseBody': 312,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 312,
 'scrapy-zyte-api/request_args/url': 312,
 'scrapy-zyte-api/status_codes/200': 312,
 'scrapy-zyte-api/success': 312,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'start_time': datetime.datetime(2025, 12, 4, 19, 0, 5, 697465, tzinfo=datetime.timezone.utc)}
2025-12-04 19:04:24 [scrapy.core.engine] INFO: Spider closed (finished)